Section 1. Databricks Lakehouse
Platform 24%
What is the value of the data Lakehouse in relation to both data warehouses and data
lakes - answer The data Lakehouse replaces the current dependency on data lakes and
data warehouses for modern data companies that desire:
Open, direct access to data stored in standard data formats.
Indexing protocols optimized for machine learning and data science.
Low query latency and high reliability for BI and advanced analytics.
By combining an optimized metadata layer with validated data stored in standard
formats in cloud object storage, the data Lakehouse allows data scientists and ML
engineers to build models from the same data driving BI reports.
Compare and contrast silver and gold tables, which workloads will use a bronze table as
a source, which workloads will use a gold table as a source - answer Bronze tables
-Contain raw data ingested from various sources
-Minimal processing occurs at this level
-Gather all data into an optimized format that data bricks can efficiently query
Silver tables
-Provide a more refined view of our data
-Data is filtered or cleansed
Gold tables
-Provide business level aggregates
-Often used for reporting and dashboarding
Identify elements of the Databricks Platform Architecture, such as what is located in the
data plane versus the control plane and what resides in the customer's cloud account -
answerControl Plane
- Databricks Account
- Web UI
- Cluster Management
- Workflows
- Notebooks
- databricks provides you with the tools to control your own infrastructure
Data Plane
- Customer Cloud Account
- Cluster VMs
- Storage (DBFS)
- compute and storage are always on your own cloud
Differentiate between all-purpose clusters and jobs clusters. - answerTypes of Clusters
----All-purpose clusters
Platform 24%
What is the value of the data Lakehouse in relation to both data warehouses and data
lakes - answer The data Lakehouse replaces the current dependency on data lakes and
data warehouses for modern data companies that desire:
Open, direct access to data stored in standard data formats.
Indexing protocols optimized for machine learning and data science.
Low query latency and high reliability for BI and advanced analytics.
By combining an optimized metadata layer with validated data stored in standard
formats in cloud object storage, the data Lakehouse allows data scientists and ML
engineers to build models from the same data driving BI reports.
Compare and contrast silver and gold tables, which workloads will use a bronze table as
a source, which workloads will use a gold table as a source - answer Bronze tables
-Contain raw data ingested from various sources
-Minimal processing occurs at this level
-Gather all data into an optimized format that data bricks can efficiently query
Silver tables
-Provide a more refined view of our data
-Data is filtered or cleansed
Gold tables
-Provide business level aggregates
-Often used for reporting and dashboarding
Identify elements of the Databricks Platform Architecture, such as what is located in the
data plane versus the control plane and what resides in the customer's cloud account -
answerControl Plane
- Databricks Account
- Web UI
- Cluster Management
- Workflows
- Notebooks
- databricks provides you with the tools to control your own infrastructure
Data Plane
- Customer Cloud Account
- Cluster VMs
- Storage (DBFS)
- compute and storage are always on your own cloud
Differentiate between all-purpose clusters and jobs clusters. - answerTypes of Clusters
----All-purpose clusters
