описание
We are a technology company specializing in Artificial Intelligence, Generative AI, Analytics, Data Governance, Cloud and Event-Driven architectures, but above all, we are a team with expertise, sound judgment and a strong desire to do things well. We work with highly specialized talent, wherever they are, and believe in growing through trust, autonomy and participation. We are looking for a Data Engineer to join the IT team of a large multinational client. The client uses Tableau at scale on Azure machines and has recently experienced performance issues whose cause is unclear.
задачи
- Extract and centralize Tableau Server performance data in Databricks: process logs (VizQL, backgrounder, gateway), the internal Tableau repository and the Resource Monitoring Tool.
- Collect Azure virtual machine metrics (CPU, memory, disk) from Azure Monitor or Log Analytics.
- Use Tableau metadata to identify which tables and data sources each workbook reads, so performance issues can be linked to their source.
- Process and model large volumes of logs with Spark in optimized Delta tables.
- Analyze bottlenecks: slow views, costly queries, overlapping extract refreshes, user spikes and machine sizing.
- Propose improvements and work with teams to implement them: workbook and data source design, refresh scheduling, server configuration and optimization of source tables.
- Prepare tables for the Genie agent (descriptions, instructions and sample queries) and check that it responds well.
требования
- At least 3 years as a Data Engineer or in a similar role.
- Experience with Spark (PySpark or Spark SQL) on very large tables, including performance optimization: partitioning, file sizes, execution plans, joins and caching.
- Experience with Databricks and Delta Lake.
- Advanced SQL.
- Experience with PostgreSQL, including querying and analyzing system or metadata databases (for example, the Tableau Server internal repository).
- Experience with large volumes of data.
- Autonomy and initiative to investigate problems without a defined solution.
- Good working level of English.
- Будет плюсом: Experience with Azure Monitor, Log Analytics or Azure virtual machine metrics; Knowledge of the Tableau Metadata API or REST API; Experience optimizing Tableau workbooks and extracts (performance recording, Hyper, live connections versus extracts); Knowledge of Tableau Server or Tableau Cloud from a technical or administrative perspective: logs, repository, administrative views or monitoring tools; Experience with log analysis tools (Logshark, Splunk, ELK or similar); Experience with Unity Catalog or Databricks Genie
условия
- Joining a company at the forefront of technology and focused on people; we put employees at the center of everything we do. We believe in a horizontal culture, without egos, in an environment where both ideas and people are valued.
- Permanent contract and a starting salary of between 38,000 and 44,000 euros gross per year, adjusted according to your experience (our career plan includes annual reviews).
- A specialized training plan.
- Participation in the company’s ownership and profits.
- Free Wetaca meals at the office two days a week.
- Flexible hours, with the option to work from wherever you want.
- Health insurance and flexible benefits with Cobee.
- In addition to the usual vacation, we offer an extra week at Christmas and three additional days at Easter.
- You will also receive a fun Welcome Kit with a laptop (you can choose from several Mac or Windows models), mobile phone, personalized bottle, Bluetooth headphones and sweets.
- When you are in our office, fruit, coffee and soft drinks are on Mática.