• ¿Documento equivocado? Cámbialo gratis
  • Escrito por estudiantes que aprobaron
  • Inmediatamente disponible después del pago
  • Leer en línea o como PDF
Vender
¿Dónde estudias?
Tu idioma
Document preview thumbnail
Vista previa 2 fuera de 11 páginas
Examen

Databricks Competition Study

Document preview thumbnail
Vista previa 2 fuera de 11 páginas

What does the Lakehouse consist of? - answer-The lakehouse brings the scalability and cost effectiveness of data lakes with the reliability and performance of data warehouses How does Databricks differentiate from Snowflake? - answer-Data Science/Machine Learning Data Ingestion ETL Streaming Capabilities Data Sharing With Snowflake, you will have high costs, limited capabilities, limited unstructured data support, inefficient engineering and vendor lock in For Data Science- how does Databricks differ from Snowflake? - answer-Snowflake is built for SQL workloads. They either use Snowpark or rely on 3rd party tools for DS and ML-like Dataiku or DataRobot Databricks can allow your data scientist to use any libraries/languages in the same platform as their DE, and manage the end-to-end ML pipeline with MLflow For Data Ingestion- how does Databricks differ from Snowflake - answer-With Snowflake ingestion go through various Snowflake stages, often needing to utilize limited SQL pipelines or Snowpipe which is inefficient and expensive 2) Snowflake tax - egress tax moving data to and from and as that data is being stored Databricks - ingestion is simple with AutoLoader where data is automatically transformed into Delta Tables For ETL- how does Databricks differ from Snowflake - answer-Snowflake has no ETL tools rely heavily on 3rd party vendors which increases cost and complexity Databricks - Delta Live Tables What is Delta Live Tables? - answer-Delta Live Tables is the first ETL framework that allows you to build reliable data pipelines (accelerate ETL development) - automatically manages your infrastructure at scale so data analysts and engineers can spend less time on tooling and focus on getting value from data. DLT- fully supports Python and SQL and works with both batch and streaming DLT - manages task oircehstration, cluster management, monitoring, data quality and error handling supports CDC (change data capture) Streaming Capabilities- how does Databricks differ from Snowflake - answer-Databricks reads in any streaming services while Snowflake only supports Kafka and was not designed for high velocity data but rather structured data at rest What Databricks features helps out with observability and governance? - answer-Expectations- help prevent bad data from flowing into tables, track data quality over time and provide tools to troubleshoot bad data with granular pipeline observability so you get a high fidelity lineage diagram of your pipeline, track dependencies and aggregate data quality metrics across all of your pipeline. For Data Sharing- how does Databricks differ from Snowflake? - answer-Snowflake's data format is proprietary, users can only share data with other Snowflake accounts (vendor lock in) -Snowflake would take the data from your cloud storage, conduct transformations and then push the data back so you are paying an egress tax to and from and as that data is going to be stored -pay for compute to send data Delta Sharing - an open standard for data sharing, no replication of datasets How does Delta Lake differ Iceberg? - answer-1) Overall performance - loading and querying data is 3.5x faster 2) Load Performance- load from Parquet to intended formats (delta is faster) 3) Query performance - Delta is 4.5x faster What are Data cleanrooms? - answer-It's a secure environment to run computations on joint data Run any computation on Python, SQL, R, or java No data replications Scalability What is Databricks Marketplace? - answer-open marketplace for data solutions, built on Delta Sharing Consist of Notebooks Data files, Data Tables Solution Accelerators ML Models Dashboards Why have data marketplaces seen limited use? - answer-Closed platforms (one per vendor) Limited to just datasets What is Project Lightspeed? - answer-Faster and simpler stream processing 1) predictable low latency 2) enhanced functionality 3) Operations and Troubleshooting 4) Connectors & Ecosystem Databricks Workflows - answer-Fully managed orchestration service Orchestration is the configuration of multiple tasks into one complete end-to-end process the goal is to streamline and optimize the execution of frequent, repeatable processes EMR - answer-ETL/stream processing many open sourced projects (Hadoop, Presto, Jupyter) are packaged and rolled into a single click which integrates well with AWS ecosystem cloud big data platform for running large scale distributed data processing jobs, interactive SQL queries EMR- EMR runtime which provides performance enhancements What does EMR

Vista previa del contenido

Databricks Competition Study
What does the Lakehouse consist of? - answer-The lakehouse brings the scalability and cost
effectiveness of data lakes with the reliability and performance of data warehouses

How does Databricks differentiate from Snowflake? - answer-Data Science/Machine Learning
Data Ingestion
ETL
Streaming Capabilities
Data Sharing
With Snowflake, you will have high costs, limited capabilities, limited unstructured data
support, inefficient engineering and vendor lock in

For Data Science- how does Databricks differ from Snowflake? - answer-Snowflake is built for
SQL workloads. They either use Snowpark or rely on 3rd party tools for DS and ML-like Dataiku
or DataRobot
Databricks can allow your data scientist to use any libraries/languages in the same platform as
their DE, and manage the end-to-end ML pipeline with MLflow

For Data Ingestion- how does Databricks differ from Snowflake - answer-With Snowflake
ingestion go through various Snowflake stages, often needing to utilize limited SQL pipelines or
Snowpipe which is inefficient and expensive
2) Snowflake tax - egress tax moving data to and from and as that data is being stored
Databricks - ingestion is simple with AutoLoader where data is automatically transformed into
Delta Tables

For ETL- how does Databricks differ from Snowflake - answer-Snowflake has no ETL tools rely
heavily on 3rd party vendors which increases cost and complexity
Databricks - Delta Live Tables

What is Delta Live Tables? - answer-Delta Live Tables is the first ETL framework that allows you
to build reliable data pipelines (accelerate ETL development)
- automatically manages your infrastructure at scale so data analysts and engineers can spend
less time on tooling and focus on getting value from data.
DLT- fully supports Python and SQL and works with both batch and streaming
DLT - manages task oircehstration, cluster management, monitoring, data quality and error
handling
supports CDC (change data capture)

Streaming Capabilities- how does Databricks differ from Snowflake - answer-Databricks reads in
any streaming services while Snowflake only supports Kafka and was not designed for high
velocity data but rather structured data at rest

, What Databricks features helps out with observability and governance? - answer-Expectations-
help prevent bad data from flowing into tables, track data quality over time and provide tools
to troubleshoot bad data with granular pipeline observability so you get a high fidelity lineage
diagram of your pipeline, track dependencies and aggregate data quality metrics across all of
your pipeline.

For Data Sharing- how does Databricks differ from Snowflake? - answer-Snowflake's data
format is proprietary, users can only share data with other Snowflake accounts (vendor lock in)
-Snowflake would take the data from your cloud storage, conduct transformations and then
push the data back so you are paying an egress tax to and from and as that data is going to be
stored
-pay for compute to send data

Delta Sharing - an open standard for data sharing, no replication of datasets

How does Delta Lake differ Iceberg? - answer-1) Overall performance - loading and querying
data is 3.5x faster
2) Load Performance- load from Parquet to intended formats (delta is faster)
3) Query performance - Delta is 4.5x faster

What are Data cleanrooms? - answer-It's a secure environment to run computations on joint
data
Run any computation on Python, SQL, R, or java
No data replications
Scalability

What is Databricks Marketplace? - answer-open marketplace for data solutions, built on Delta
Sharing
Consist of
Notebooks
Data files, Data Tables
Solution Accelerators
ML Models
Dashboards

Why have data marketplaces seen limited use? - answer-Closed platforms (one per vendor)
Limited to just datasets

What is Project Lightspeed? - answer-Faster and simpler stream processing
1) predictable low latency
2) enhanced functionality
3) Operations and Troubleshooting
4) Connectors & Ecosystem

Información del documento

Subido en
29 de septiembre de 2024
Número de páginas
11
Escrito en
2024/2025
Tipo
Examen
Contiene
Preguntas y respuestas
$12.49

¿Documento equivocado? Cámbialo gratis Dentro de los 14 días posteriores a la compra y antes de descargarlo, puedes elegir otro documento. Puedes gastar el importe de nuevo.
Escrito por estudiantes que aprobaron
Inmediatamente disponible después del pago
Leer en línea o como PDF

Seller avatar
Los indicadores de reputación están sujetos a la cantidad de artículos vendidos por una tarifa y las reseñas que ha recibido por esos documentos. Hay tres niveles: Bronce, Plata y Oro. Cuanto mayor reputación, más podrás confiar en la calidad del trabajo del vendedor.
TOPDOCTOR
5.0
(1)
Vendido
10
Seguidores
5
Artículos
3387
Última venta
1 año hace



Por qué los estudiantes eligen Stuvia

Creado por compañeros estudiantes, verificado por reseñas

Calidad en la que puedes confiar: escrito por estudiantes que aprobaron y evaluado por otros que han usado estos resúmenes.

¿No estás satisfecho? Elige otro documento

¡No te preocupes! Puedes elegir directamente otro documento que se ajuste mejor a lo que buscas.

Paga como quieras, empieza a estudiar al instante

Sin suscripción, sin compromisos. Paga como estés acostumbrado con tarjeta de crédito y descarga tu documento PDF inmediatamente.

Student with book image

“Comprado, descargado y aprobado. Así de fácil puede ser.”

Alisha Student

Preguntas frecuentes