data engineer

No description

• Define and enforce best practices and coding standards across the project;
• Conduct thorough code reviews to ensure adherence to established guidelines and maintain high code quality;
• Work both independently and in close collaboration with team members;
• Communicate clear instructions to team members and assist in managing daily operational workflows;
• Maintain regular communication with the client;
• Design, develop, and maintain robust and scalable Spark applications;
• Write clean, maintainable, and efficient code in accordance with best practices and coding standards;
• Optimize code for performance and scalability to ensure efficient data handling;
• Collaborate closely with cross-functional teams to deliver high-quality software solutions;
• Identify and resolve technical issues to ensure application reliability and performance;
• Create and maintain comprehensive documentation for code, processes, and workflows.

• 5+ Years of hands-on experience in software development;
• Extensive experience with Apache Spark, including platforms such as Databricks and/or Azure Synapse/Fabric;
• Proficiency in Python, with strong skills in data manipulation using Pandas, Polars, and similar libraries;
• Solid understanding of columnar data storage formats, particularly Parquet, with practical experience using Delta Tables;
• Proven expertise in data processing, analysis, and transformation workflows;
• Strong analytical and problem-solving abilities with a detail-oriented mindset;
• Practical and pragmatic approach to balancing standardized processes with the flexibility required to meet project goals effectively;
• Excellent organizational skills, including the ability to self-manage, prioritize tasks, structure workload, and meet tight deadlines;
• Solid understanding of microservices architecture and its implementation in scalable systems;
• Intermediate+ English;
• Nice to have: Experience with Azure Cloud services (or other major cloud platforms) including Service Bus, Data Lake, Blob Storage, and Redis, familiarity with FastAPI, expertise in containerization and orchestration tools such as Docker.

• No conditions specified