Databricks
Apache Spark - answer An open source analytics environment for large, heterogeneous
data sets that provides capabilities from analytics to the maintenance of broadly
distributed data storage systems. The compute engine used by Databricks.
pandas - answerA software library written for the Python programming language for
data manipulation and analysis. Best suited for smaller datasets.
Databricks Magic Commands for Languages - answer Switch between program
languages at the beginning of a cell: %python, %scala, %sql and %r
code to switch from python (default) to sql - answer% SQL SELECT * FROM
database.tablename
Auxiliary magic command, run shell command - answer%sh
Auxiliary magic command, use dbutils filesystem commands - answer%fs
Auxiliary magic command, add markdown to your notebook - answer%md
DBFS - answerDatabricks File System
Delta lake - answerAn open source storage layer that brings reliability to data lakes.
Delta Lake provides... - answerACID transactions, scalable metadata handling, and
unifies streaming and batch data processing.
JSON (JavaScript Object Notation) file - answera file, which is a standard data
interchange format.
Spark Cluster - answerA collection of machines or nodes in the public cloud or on-
premise in a private data center on which Spark is installed. Includes Spark workers, a
Spark Master (also a cluster manager in a standalone mode) and at least on Spark
Driver.
JVM (Java Virtual Machine) - answerSoftware inside various electronic platforms that
reads and runs compiled bytecode.
Spark Master JVM - answerActs as a cluster (resource) manager in a Standalone
deployment mode to which Spark workers register themselves as part of a quorum.
Spark Worker - answerLaunches an executor on behalf of the master.
Apache Spark - answer An open source analytics environment for large, heterogeneous
data sets that provides capabilities from analytics to the maintenance of broadly
distributed data storage systems. The compute engine used by Databricks.
pandas - answerA software library written for the Python programming language for
data manipulation and analysis. Best suited for smaller datasets.
Databricks Magic Commands for Languages - answer Switch between program
languages at the beginning of a cell: %python, %scala, %sql and %r
code to switch from python (default) to sql - answer% SQL SELECT * FROM
database.tablename
Auxiliary magic command, run shell command - answer%sh
Auxiliary magic command, use dbutils filesystem commands - answer%fs
Auxiliary magic command, add markdown to your notebook - answer%md
DBFS - answerDatabricks File System
Delta lake - answerAn open source storage layer that brings reliability to data lakes.
Delta Lake provides... - answerACID transactions, scalable metadata handling, and
unifies streaming and batch data processing.
JSON (JavaScript Object Notation) file - answera file, which is a standard data
interchange format.
Spark Cluster - answerA collection of machines or nodes in the public cloud or on-
premise in a private data center on which Spark is installed. Includes Spark workers, a
Spark Master (also a cluster manager in a standalone mode) and at least on Spark
Driver.
JVM (Java Virtual Machine) - answerSoftware inside various electronic platforms that
reads and runs compiled bytecode.
Spark Master JVM - answerActs as a cluster (resource) manager in a Standalone
deployment mode to which Spark workers register themselves as part of a quorum.
Spark Worker - answerLaunches an executor on behalf of the master.
