Explain Spark Architecture & its working
Big Data Consultant Interview Questions
1,784 big data consultant interview questions shared by candidates
Los proyectos en los que había trabajado y las tecnologías que había usado. Porque quería cambiar de empresa y porque estaba desasignado actualmente en la empresa y porque me habían sacado del último proyecto en el que había estado trabajando. Qué pensaba que podría aportar al equipo de trabajo.
1. Hive Heap Size Memory Issue 2. HIve Optimization 3. Hive Sub Partition Deletion 4. HIve Stages 5. Add column in between existing columns in Hive 6. Map Join in Hive 7. Change or Check Block SIze 8. Spark Optimization 9. Spark Shared Variables 10. Spark Stages 11. Compress & Decompress Time Comparison of Parquet with others 12. Bloom Filter in HIve 13. 3rd Highest Salary by each department using Spark DataFrame(Not using Hive or SparkSQL) 14. Spark Cache vs Broadcast 15. Create DataFrame in Spark 16. Spark Partition 17. ACID properties in Hive & Spark 18. Count in Spark without using count func() 19. Shuffle Read & Shuffle Write in Spark 20. Spark cache is action or transformation? 21. Spark 1.x vs 2.x 22. What is hint?
What is the difference between class and id in HTML?
A little background questions.
HBASE architecture concepts, Spark architecture Concepts, difference between Hbase and Hive, why Hive/Sqoop, concepts of HDFS architecture, current Project, Versions of component, cluster specifications. If you are good at python that would be great.
Ask about previous Project you worked on . and some Technology related
Codility test: Grundlegender Programmiertest von Algorithmen mit Schleifen und Rekursion.
How big your company cluster is?
How do you design an architecture for big data of 20 TB per day.
Viewing 901 - 910 interview questions