Big data platform engineer in smart city

At World Tech Enterprises, we are looking for two senior profiles for one of our clients to join a long-term project involving the administration, operation, and support of a Big Data platform in the Smart City field. Both profiles will work on the same environment, with distinct and complementary roles.

• Administration of systems, applications, and environments.
• Monitoring and analysis of logs and traces.
• Management of availability, service recovery, backups, and restores.
• Deployments, updates, and management of capacity and performance.
• Operational security, task automation, and procedure documentation.
• Configuration and parameterization of products.
• Specialized troubleshooting and L3 support.
• Integration between products and analysis of dependencies and impact.
• Upgrades, validation of new versions, and technical evaluation of products.
• Specialized support for the operations team.

• At least 6–7 years of experience in systems administration in Big Data projects.
• At least 5 years with open-source Big Data platforms in the Smart City field.
• Hands-on experience administering systems, infrastructure, and applications in production environments.
• Proficiency in Linux and Kubernetes.
• Experience with Kafka, Apache Airflow, ELK (Elasticsearch / Kibana), and Grafana.
• Scripting in Shell and/or Python, and Java at an operational level.
• Knowledge of networking, certificates, and connectivity.
• Deployments, upgrades, troubleshooting, and L2/L3 production support.
• At least 5 years as a product specialist in Big Data projects in the Smart City field.
• Practical experience configuring, integrating, updating, and resolving incidents in data platform products.
• Knowledge of several of these components (you do not need to master them all): WSO2 (API Publisher, API Store, Identity Server), Kafka and Apache Airflow, data stack: Hive, Kudu, Phoenix, Apache Ranger, Solr, Kubernetes, ELK, and Grafana.
• Будет плюсом: A plus: Apache Jena Fuseki, GeoServer, Jupyter, HUE, R/RStudio, and Java; We will especially value a combination of WSO2 + Kafka/Airflow + data stack + Kubernetes

• Permanent employment contract.
• 100% remote work.
• Office hours.
• 23 days of vacation per year + December 24 and 31 as holidays.
• Competitive salary based on the experience you bring.
• Joining a stable, long-term technology project.