Typical data engineering stuff, like batch or steaming pipeline etc.
Lead Data Engineer Interview Questions
239 lead data engineer interview questions shared by candidates
explain your experience in data engineering
En SQL, trouver le top 10 des films les plus populaires par catégorie.
What routing protocols are you most comfortable with?
Toughest work that you did?
How to manage critical things
The most over-the-top question INTERVIEWER asked was likely one involving a case scenario about optimizing "first-click attribution" for an enterprise e-commerce website, using a messaging bus like Kafka or Azure Event Hub, with a data ingestion rate of 10 million messages per minute. He wanted to know my approach to handling this data, including service choices and implementation steps to make the data consumable for the stakeholders. The question was over the top for a few reasons: 1. It involved multiple layers—selecting the appropriate tools, setting up data ingestion and processing pipelines, and optimizing data for real-time attribution analysis—all under significant data volume and velocity constraints. 2. INTERVIEWER asked you to devise an end-to-end solution, including technical decisions, without providing enough time to properly analyze or think through the problem. He wanted you to solve a highly complex scenario on the fly, which is not a reasonable expectation for a typical interview setting. 3. While providing constraints like the volume of data and some basic requirements, INTERVIEWER left out many details that would be crucial for designing a solution, such as specific business requirements, data quality expectations, and the existing technical architecture. This question felt designed to challenge you in an impractical way, possibly setting up a scenario where it would be difficult to provide a fully satisfying answer in the limited time available.
How to Build ETL pipelines on GCP? Architecture of Dataflow and Cloud composer.
Previous projects, leadership experience and tech skills.
Spark/Scala questions and questions related to the presentation I prepared.
Viewing 131 - 140 interview questions