Description
📈 Architect Our Data Pipelines:
We are looking for an experienced Python Developer in Data Engineering to design and build high-load processes for collecting, transforming, and processing massive volumes of data in London.
💾 Core Duties:
• Write and optimize ETL/ELT scripts in Python to import data from diverse sources.
• Develop, configure, and monitor data processing pipelines in Apache Airflow.
• Design database schemas and optimize complex analytical SQL queries in PostgreSQL and ClickHouse.
• Perform data quality checks, analyze anomalies, and ensure information integrity.
• Optimize database performance and the processing speed of large log and transactional data arrays.
🛠️ Required Skills:
• 3+ years of commercial Python development experience focused on Data Engineering / ETL.
• Deep SQL knowledge and experience with relational and columnar databases (PostgreSQL, ClickHouse).
• Practical experience with the Apache Airflow orchestrator (creating and managing DAGs).
• Understanding of Data Warehouse (DWH) architecture, data modeling methods, and JSON, Parquet, CSV formats.
• Strong command of Linux CLI, Docker, and Git.
✨ The Package:
• Competitive salary: £65,000 GBP per annum.
• Full-time, on-site role in our comfortable London office.
• Official employment, paid annual leave, and comprehensive health coverage.
• Modern hardware and equipment, plus sponsorship for courses and certifications.
• Work on complex architectural challenges alongside a friendly team of engineers.