CSCI 515 Section 1 Exam Questions and Answers.

CSCI 515: Section 1 Exam Questions and Answers Data Engineering - Correct Answers: Is to identify, investigate, and analyze the underlying principles in the design and effective use of information systems. Data Management - Correct Answers: Comprises all the disciplines related to managing data as a valuable resource. Data Life Cycle - Correct Answers: The sequence of stages that a particular unit of data goes through from its initial generation or capture to its eventual applications at the end of its useful life Data Collection - Correct Answers: The process of gathering and measuring information on targeted variables in an established system, which then enables one to answer relevant questions and evaluate outcomes. In this phase, data comes into an organization, usually through data entry, acquisition from an external source, or signal reception (such as transmitted sensor data). Data Preparation - Correct Answers: The process of cleaning and transforming raw data prior to processing and analysis. It often involves reformatting data, making corrections to data, and the combining of data sets to enrich data. Indexes - Correct Answers: Used to quickly locate data without having to search every data item in storage. Data Structures - Correct Answers: These are created and used to improve the speed of data retrieval operations on the data. Data Processing and Analysis - Correct Answers: This phase is a process of inspecting, cleansing, transforming and modeling data with the goal of discovering useful information, informing conclusion and supporting decision-making. It has multiple facets and approaches, encompassing diverse techniques under a variety of names. Data Visualization - Correct Answers: The graphic representation of data. It involves producing images that communicate relationships among the represented data to viewers of the images. Data Sharing - Correct Answers: In this phase, to have a greater impact, the valuable results may be shared with a broader audience, which could be the general public or just outside the organization. Data Applications - Correct Answers: In this phase, data is used to support the organization's objectives and operations, e.g., improving sales or recommendations. Problem Specifications - Correct Answers: A set of data may be useful for an application, but may be useless for another application. Before collecting data, target data needs to be specified exactly in this phase. Data Indexing and Storage - Correct Answers: Data structures are created and indexes are used in this stage. The Phases of the Data Life Cycle - Correct Answers: 0. Problem Specifications, 1. Data Collection, 2. Data Preparation, 3. Data Indexing and Storage, 4. Data Processing and Analysis, 5. Data Visualization, 6. Data Sharing, 7. Data Applications Components of a Typical Web Search - Correct Answers: 1. Traversal crawlers, 2. Indexing software, 3. Search and ranking software Traversal Crawlers - Correct Answers: Software that automatically scans various web sites and collects web documents from them. They follow the links on a site to find other relevant pages. Depth/breadth -first search method is usually used for the web page traversal. Indexing Software/Automatic Indexing - Correct Answers: The process of algorithmically examining information items to build a data structure that can be quickly searched. Search and Ranking Software - Correct Answers: This software analyzes a query and compares it to the indexes to find and determine in which order to display the relevant pages. Location Based Service (LBS) - Correct Answers: A service based on the geographical position of a mobile handheld device An Example of a Location Based Service (LBS) - Correct Answers: (.) Find the interesting nearby places such as ethnic restaurants, movie theaters, and landmarks, (.) Compare prices and perform product research, (.) Advertisements and coupons are displayed based on users' locations, (.) Use social networks to connect people within a short distance. Components of A System Structure of Location Based Services - Correct Answers: 1. Mobile handheld devices, 2. Positioning system, 3. Mobile and wireless networks, 4. Service providers, 5. Geographical data providers Mobile handheld devices - Correct Answers: Small computers that can be held in one hand. For most cases, they are smartphones. Positioning system - Correct Answers: A navigation satellite system that provides location and time information to anyone with a receiver, Mobile and Wireless Networks - Correct Answers: These relay the query and location information from devices to service providers and send the results from the providers to devices Service Providers - Correct Answers: Provide the location-based services Geographical Data Providers - Correct Answers: Databases storing a huge amount of geographical data such as information about restaurants and gas stations Data Science - Correct Answers: An interdisciplinary field about scientific methods, processes, and systems to extract knowledge or insights from data in various forms, either structured or unstructured, similar to data mining. Data Mining - Correct Answers: An activity which is a part of a broader Knowledge Discovery in Databases (KDD) process Steps of the Data Science Process - Correct Answers: 1. Frame the problem, 2. Collect the raw data, 3. Process the data for analysis, 4. Explore the data, 5. Perform in-depth analysis, and 6. Communicate results. Data Engineer - Correct Answers: Someone who develops, constructs, tests and maintains architectures, such as databases and large-scale processing systems. Duties of a Data Engineer - Correct Answers: (.) Deal with raw data that contains human, machine, or instrument errors. (.) Need to recommend and sometimes implement ways to improve data reliability, efficiency, and quality. (.) Need to employ a variety of languages and tools to marry systems together, so the information can be further processed by data scientists. (.) Ensure that the architecture that is in place supports the requirements of the data scientists and the business. (.) Develop data set processes for data modeling, mining, and production. Data Scientist - Correct Answers: Someone who cleans, massages, and organizes (big) data. They will usually already get data that has passed a first round of cleaning and manipulation, which they can use to feed to sophisticated analytics programs and machine learning and statistical methods to prepare data for use in predictive and prescriptive modeling. Popular Tools for Data Scientists - Correct Answers: SPSS, R (+ ggplot2 package)^, Python (+ Pandas package)^, SAS, Stata, Julia, Scikit-Learn, NumPy, Matplotlib, Statsmodels, Tableau, Rapidminer, Matlab, Excel, Gephi. (^Most popular) Popular Tools for Data Engineers - Correct Answers: SAP, Oracle, Cassandra, MySQL, Redis, Riak, PostgreSQL, MongoDB, neo4j, Hive, and Sqoop Background Needed for Data Science - Correct Answers: Computer Science, Econometrics, Mathematics, Statistics, Operations Research Background Needed for Data Engineering - Correct Answers: Computer Science, Engineering, and Computer Engineering Data Scientist Hiring Practices - Correct Answers: Companies are looking to compose data science teams instead of hiring unicorn data scientists For recruiters, it's hard finding them and the demand clearly exceeds the supply. Popular Tools for Both Data Scientists and Engineers - Correct Answers: Scala, Java, and C# Unicorn Data Scientist - Correct Answers: Someone that possess communication skills, creativity, cleverness, curiosity, technical expertise, etc. Someone that embodies all the qualities that companies are looking for.