All big data concepts were asked from basics to advanced
Big Data Engineer Interview Questions
1,228 big data engineer interview questions shared by candidates
Apache Spark related question (e.g. wha is is DAG in spark)
The first question was how to tmplement LinkedList. The second question was to identify if person A knows person B directly or indirectly given a group on LinkedList containing their "know" relation.
SQL/Python related question for logic building. Another round consists of apache spark framework and Azure cloud and few questions over my project.
Different types of dimensions in Datawarehouse
to write SQL queries and Pyspark coding to load, filter, aggregate and save as another new table, strategies to design ETL validations to merge to consume kafka and s3 bucket files. Strategies to consume data from s3 bucket focusing on spark architecture, designing clusters, shuffling, narrow/wide transformations, authenticating Azure data lakes, resource manager in spark.
Hive, spark, sql, hbase
Left view of tree
If you had 4 days to complete a task but it was reduced to 2 days what would you do.
design an alert system
Viewing 1071 - 1080 interview questions