Senior Big Data Engineer Interview Questions

108 senior big data engineer interview questions shared by candidates

Discussion around current project and challenges around it. How would you scale the current infrastructure? System design related questions. Write a program to find x number of max elements from m number of sorted arrays. General discussion around your project. Write spark code to find the unique routes from a given flight routes table where there could be individual entry for MumBai --> Kolkata/Kolkata--> Mumbai Write a spark scala code to get the employee who earns highest among employess whose salary is more than avg salary and age is less than the avg age. What is master in Spark? What does appName do in Spark? How the local scheduler work in Apache Airflow? How it differs from Kubernetes? Questions around airflow architecture. Given two programs for word count tell the difference between reduceBykey and groupbyKey?
avatar

ICT IV | Senior Big Data Engineer

Interviewed at Apple

4.1
Aug 15, 2020

Discussion around current project and challenges around it. How would you scale the current infrastructure? System design related questions. Write a program to find x number of max elements from m number of sorted arrays. General discussion around your project. Write spark code to find the unique routes from a given flight routes table where there could be individual entry for MumBai --> Kolkata/Kolkata--> Mumbai Write a spark scala code to get the employee who earns highest among employess whose salary is more than avg salary and age is less than the avg age. What is master in Spark? What does appName do in Spark? How the local scheduler work in Apache Airflow? How it differs from Kubernetes? Questions around airflow architecture. Given two programs for word count tell the difference between reduceBykey and groupbyKey?

2nd stage was a matching and linkage case study, was very clear that the interviewers had no clue about big data or how to apply it. In fact, they weren't even clued up on NLP approaches or simple string matching. 3rd stage was a slither game whiteboard - was like talking to 4 noobs that had just come out of uni
avatar

Senior Developer (Big Data)

Interviewed at Experian

4.1
Mar 14, 2017

2nd stage was a matching and linkage case study, was very clear that the interviewers had no clue about big data or how to apply it. In fact, they weren't even clued up on NLP approaches or simple string matching. 3rd stage was a slither game whiteboard - was like talking to 4 noobs that had just come out of uni

Viewing 31 - 40 interview questions

Glassdoor has 108 interview questions and reports from Senior big data engineer interviews. Prepare for your interview. Get hired. Love your job.