Data Science - Big Data Assessment Exam
Questions with 100% Verified Answers
The client mode and cluster mode are the two deploy modes that can be used to
launch Spark applications on YARN. In cluster mode, the Spark driver runs inside
an application master process which is organized by YARN on the cluster, and the
client can go away after commencing the application. In client mode, the driver
runs in the client process, and the application master is only used for requesting
resou - ✔️✔️- yarn support launching of spark app in client mode and cluster mode
deployment
??
what is replication factor?
- replication factor controls how many times the Name node replicates the meta
data
- replication factor creates multiple copies of the same file to be served to the
clients
- replication factor controls how many times each individual block can be
replicated
- all - ✔️✔️all
,explanation:
.The number of nodes where data (rows and partitions) is replicated is equal to
the Replication Factor (RF). Data is duplicated over many nodes (RF=N).There is
only one copy of a row in a cluster with an RF of one, and there is no way to
retrieve the data if the node is hacked or fails. A cluster with RF=2 has two copies
of the same row. In most systems, an RF of at least three is utilized.Data is
duplicated automatically at all times. Data stored on any of the replicated nodes
can be read or written to.
find the appropriate Scala statement to load the Transaction file into an RDD.
Assume that SparkContext is available as "scCntxt" and SQLContext as "sqlCntxt"?
val inData=sqlContext.loadText("/path to file/txn.txt")
val inData=sc.loadFile("/path to file/txn.txt")
val inData=sc.textFile("/path to file/txn.txt")
val inData=sc.loadText("/path to file/txn.txt") - ✔️✔️val inData=sc.textFile("/path
to file/txn.txt")
Oozie workflow jobs are Directed _____ graphs of actions?
- acyclical
-cyclical
-elliptical
, - all the above - ✔️✔️acyclical
which of the following will give min value of votes in the dataframe "df"?
df.max()
df.agg(min("votes")).show()
df.agg().min("votes").show()
none - ✔️✔️df.agg(min("votes")).show()
the client reading the data from HDFS fileSystem in Hadoop does which of the
following?
gets the data from the namenode
gets both the data and block location from the namenode
gets the block location from the datanode
gets only the block locations from the namenode - ✔️✔️gets only the block
locations from the namenode
Questions with 100% Verified Answers
The client mode and cluster mode are the two deploy modes that can be used to
launch Spark applications on YARN. In cluster mode, the Spark driver runs inside
an application master process which is organized by YARN on the cluster, and the
client can go away after commencing the application. In client mode, the driver
runs in the client process, and the application master is only used for requesting
resou - ✔️✔️- yarn support launching of spark app in client mode and cluster mode
deployment
??
what is replication factor?
- replication factor controls how many times the Name node replicates the meta
data
- replication factor creates multiple copies of the same file to be served to the
clients
- replication factor controls how many times each individual block can be
replicated
- all - ✔️✔️all
,explanation:
.The number of nodes where data (rows and partitions) is replicated is equal to
the Replication Factor (RF). Data is duplicated over many nodes (RF=N).There is
only one copy of a row in a cluster with an RF of one, and there is no way to
retrieve the data if the node is hacked or fails. A cluster with RF=2 has two copies
of the same row. In most systems, an RF of at least three is utilized.Data is
duplicated automatically at all times. Data stored on any of the replicated nodes
can be read or written to.
find the appropriate Scala statement to load the Transaction file into an RDD.
Assume that SparkContext is available as "scCntxt" and SQLContext as "sqlCntxt"?
val inData=sqlContext.loadText("/path to file/txn.txt")
val inData=sc.loadFile("/path to file/txn.txt")
val inData=sc.textFile("/path to file/txn.txt")
val inData=sc.loadText("/path to file/txn.txt") - ✔️✔️val inData=sc.textFile("/path
to file/txn.txt")
Oozie workflow jobs are Directed _____ graphs of actions?
- acyclical
-cyclical
-elliptical
, - all the above - ✔️✔️acyclical
which of the following will give min value of votes in the dataframe "df"?
df.max()
df.agg(min("votes")).show()
df.agg().min("votes").show()
none - ✔️✔️df.agg(min("votes")).show()
the client reading the data from HDFS fileSystem in Hadoop does which of the
following?
gets the data from the namenode
gets both the data and block location from the namenode
gets the block location from the datanode
gets only the block locations from the namenode - ✔️✔️gets only the block
locations from the namenode
