clients Silverbird

Data Engineer with Web Scraping Expertise

Location

Georgia

Job Type

Full-time

Experience

N/A

Salary

N/A

Skill Set

Role

All Other Remote

Job Details

At Silverbird, we're a fast-growing fintech start-up that's changing the game when it comes to international trade. We understand that small and medium-sized enterprises from developing countries face significant barriers when it comes to accessing financial services, and we're here to change that. We're proud to be part of a $500B market opportunity in payments and FOREX, and we're committed to leveraging innovative technology to create solutions that enable merchants to grow their businesses internationally. We believe that the future of trade is borderless, and we're excited about the role we're playing in making that vision a reality.

In just two years, we've gone from a team of 5 to over 120, and we're on track to add another 100 people to our ranks this year. We value the unique strengths and talents of our team members. We're a team who thrives in the fast-paced and dynamic environment of a start-up. We're united by our shared passion for what we do and our commitment to working collaboratively to achieve our ambitious goals.

At Silverbird, we believe in fostering an environment of agility and adaptability, while maintaining a clear and defined structure. Being a start-up, we value hard work, but also recognize the importance of work-life balance. Our team is composed of professionals who are passionate about innovation and are dedicated to making a positive impact in the world.

One of the main values for us is to be globally empathetic. We embrace diversity as a constant source of wisdom and wonder in the world. We are an equal opportunity employer and do not discriminate based on legally protected characteristics such as race, religion, color, national origin, gender, sexual orientation, marital status, veteran status, or disability status.

Currently, we are searching for a Data Engineer with web scraping expertise. You will be reporting to our Head of Data and hold responsibility over maintaining an environment that is as flat and approachable as possible while ensuring an MVP approach to product development.

Key Responsibilities

  • Create ETLs for transferring data from Web sources (directly from web pages or API).
  • Develop web scraping solutions for parsing data from various sources bypassing any blockers.
  • Facilitate and explore ways to enhance data quality and reliability (monitoring of ETLs, datasets checks, etc.)

Requirements

  • Experience in web scraping techniques and tools, including avoiding captchas and other security measures is a must!
  • Experience in the field 3+ years
  • Experience working with REST APIs
  • Proficiency in Python and SQL languages
  • Basic knowledge of HTML, JavaScript
  • Experience with relational databases. Postgres is an advantage
  • Familiarity with data warehousing (e.g Big Query, Snowflake) ETL/ELT Solutions, and data pipeline architecture (e.g Airflow)
  • English - upper intermediate


Technologies

  • Postgres for DWH
  • Airflow for ETL management and monitoring
  • Python/DBT and SQL
  • Docker

Benefits

  • Competitive base salary
  • Remote work
  • You will become part of an amazing culture with a supportive CEO and smart teammates who actually care
  • You will work with an amazing team you can learn from and teach
  • You will experience joining a high-growth/high-traction organization, with the ability to make an impact
  • Free English classes via SkyEng