Write code to send a request to an API and process the response
Lead Data Engineer Interview Questions
239 lead data engineer interview questions shared by candidates
A time that I initiated change - how big was the audience of stakeholders that I needed to coordinate change with.
hands on sql questions. data transformation questions.
Q: How long can you design an industrial IoT system for the advanced manufacturing system? Q: What factors will you consider when you optimize the data pipeline from sensors to database and business intelligence? Q: How do you build and optimize data processes in an existing production environment? Q: Please describe your favorite work situation Q: How will you build and improve the team’s competency level and development roadmap?
They asked me to solve two fairly straightforward algo problems in python.
1st Round How to run an adf trigger on the last working day of the month? Why not using databricks warehouse? Pyspark coding level optimization Pyspark withcolumn and when-otherwise syntax. Will I need to Unpersist with job cluster?SQL - Top third highest salary Have you led a team? How large, who did the requirement gathering? Agile methodology 2nd Round How did u connect to SAP from ADF? - Open hub destination? Partitioning, Photon, liquid clustering, Z ordering. Will Z ordering work on a column if it is multiline(others are string)? Databricks workflow for which use case? Unity Catalogue -> How to migrate existing workspace to it? How to read Data from tables located in some other region? Given two large fact tables identify if they are exactly the same. Ans. indexing - hash and compare. Given two large fact tables with join, how to optimise for performance? Real time use case - how ingesting and orchestrating for million of records. Authorisation for the API. Write strategies for large tables - Size of your table/data. Different join strategies. Un nesting and reading of JSON. Details and e.g. Explode,Split,etc Struct type , Struct Field Setup and Run Python outside databricks environment. SQL based on windows functions with cumulative sum. Another on self join (Leetcode medium) 3rd Round - Liquid clustering, z-order, partition - Write strategies for large table - Size of your table/data - Data Mesh - Setup and Run Python outside databrciks environment - Tier of AAS and ADB? How to optimize? - How did u connect to SAP from ADF? - Open hub destination? - Unity Catalogue -> How to migrate existing workspace to it?, How to read Data from table located in some other region? - RLS - Trained or used AWS/Snowflake/GCP?
All questions was very simple
Na etapa com o Delivery Manager, o bate-papo teve foco em entender como é o meu perfil de liderança, como eu agiria em determinadas situações, como me vejo em X anos na empresa, como os meus objetivos pessoais e profissionais estão alinhados com os objetivos estratégicos da organização, e quais eram as minhas dúvidas em relação à empresa que o DM pudesse me ajudar a esclarecer.
Na entrevista técnica, houve questões relacionadas à modelagem de dados, conceitos, etc. Também foi necessário desenhar uma arquitetura de dados em nível macro para uma determinada situação, bem como escrever códigos em SQL, Python e PySpark para algumas poucas questões, porém, nada extremamente complexo.
Tell me about your employment history and your professional experience.
Viewing 221 - 230 interview questions
See Interview Questions for Similar Jobs
Bigdata EngineerSenior Data EngineerPrincipal Data EngineerBig Data EngineerDatastage DeveloperOracle Data Warehouse DeveloperData Warehouse DeveloperSr Data EngineerDeveloper It ApplicationsEtl Informatica DeveloperSenior Data Warehouse DeveloperData EngineeringHadoop Spark DeveloperSenior Data ConsultantEtl ArchitectEtl Datastage DeveloperEtl DeveloperJunior Data Engineer