Questions based on previous work experience from resume. Situation/behavioral questions. Issues you faced, how you resolved while implementing data pipelines. Questions around strategies and experience of massive data migration from on-prem to Cloud.
Interview questions were very simple. You would are they really hiring or what? What is difference between RDD, DF and DS in Spark? What are the benefits of spark over MR? What are transformations and actions? Difference between map and flatMap? The interview with VP was about team fit. The last interview also seemed like they wanted me to join so team lead explained how he will help me in my career progression in the team. However, I ended up not getting the offer. they scheduled all interviews in one go. They don't have clear process to follow. I had answered all my questions correctly. So, I was very hopeful. However, after a week, recruiter didn't show professionalism to send feedback and I sent couple of emails, then she called me saying that they need someone with more Scala exposure. I knew it was just an excuse as they very rarely asked Scala questions. It was more about chit chat rather than techincal. So, it turned out I wasted four hours of mine. One big time suggestion to them is that they should learn to create a process for hiring. If candidate was not good technically, they should stop at that point rather than wasting candidate's time.
Why are you leaving your current company?
query over some tables a difficult SQL that required joins, group-by clauses, and window functions very basic python coding. how would you design a service for shorting URLs
Explain Spark architecture in detail
Explain about your previous projects and asked everything in detail.
Coding questions on Dynamic programming, recursion and SQL. Big Data technical questions
Most of the questions are from my project.
Can you explain the ETL process? What are its primary components? What are some common challenges in data engineering, particularly when dealing with big data? How would you design and implement a data pipeline for processing and analyzing streaming data? What are some popular tools and technologies used in data engineering, and how are they typically used? Describe the concept of data warehousing. What are the benefits of using a data warehouse?
Viewing 2421 - 2430 interview questions