Data Engineer
Europe | Full-time
Responsibilities
- Communicate with both technical and non-technical audiences to gather requirements
- Review and analyze data and logic to ensure consistency and accuracy
- Design, implement, and maintain data pipelines for efficient data flow
- Integrate and support of developed solutions
- Research and evaluate third-party components for potential use
- Follow best engineering practices: refactoring, code review, testing, continuous delivery, and Scrum
- Design, optimize, and support of data storage
Requirements
- 3+ years of commercial experience in Data Engineering
- Experience gathering business requirements and communicating with stakeholders
- Strong knowledge of Data Warehouse (DWH) architecture and principles
- Hands-on experience designing data warehouses and building ETL pipelines
- Deep practical experience with Python
- Hands-on experience in one or more of the following areas: data processing using PySpark, Apache Spark, Pandas, or similar frameworks; data scraping; integration of third-party data sources and APIs Proficiency in SQL and relational databases such as PostgreSQL and MySQL
- Hands-on experience with column-oriented databases such ClickHouse, Snowflake, Cassandra, BigQuery (many tables with millions of records and above each)
- Solid understanding of software design patterns, algorithms, and data structures Intermediate English proficiency
Will be a plus
- Experience with messaging platforms such as RabbitMQ or Kafka
- Familiarity with DataOps practices and data pipeline automation
- Familiarity with CI/CD pipelines and Kubernetes environments
- Background in FinTech or Trading domains
We offer
- Tax expenses coverage for private entrepreneurs in Ukraine
- Expert support and guidance for Ukrainian private entrepreneurs
- 20 paid vacation days per year
- 10 paid sick leave days per year
- Public holidays as per the company’s approved Public holiday list
- Medical insurance
- Opportunity to work remotely
- Professional education budget
- Language learning budget
- Wellness budget (gym membership, sports gear and related expenses)