Technology and Data — Comprehensive Study Notes
These notes provide a structured overview of modern technology and data-related fields. They cover foundations,
practical workflows, common tools, use cases, and current industry directions. The material is organized for
students, self-learners, and anyone preparing concise revision notes or a project file.
1. Introduction to Technology and Data
Technology is the application of scientific knowledge, engineering, and computational systems to solve problems.
Data is the raw material of the digital world: numbers, text, images, audio, logs, transactions, and sensor readings
that can be stored, processed, analyzed, and converted into decisions.
• Technology includes computers, software, networks, cloud platforms, automation, AI systems, cybersecurity
tools, and digital devices.
• Data refers to facts or observations collected from people, machines, applications, and environments.
• Information is processed data with meaning.
• Knowledge is insight gained from information and experience.
• Decision intelligence is the use of analytics, models, and business rules to guide actions.
Why Technology and Data Matter
• They power businesses, governments, healthcare, finance, education, e-commerce, entertainment, and
scientific research.
• Organizations use data to understand customers, optimize operations, reduce risk, automate work, and create
new products.
• Modern careers increasingly require digital literacy, programming awareness, and data interpretation skills.
2. Artificial Intelligence (AI) and Machine Learning (ML)
Artificial Intelligence is the broader field of building systems that perform tasks associated with human
intelligence, such as understanding language, recognizing patterns, reasoning, making recommendations, and
generating content. Machine Learning is a subset of AI in which systems learn patterns from data instead of
relying only on hand-written rules.
2.1 Core Concepts
• AI: umbrella field covering rule-based systems, search, planning, expert systems, robotics, NLP, computer
vision, and generative AI.
• ML: algorithms learn relationships from data to make predictions or decisions.
• Model: the mathematical representation learned from training data.
• Training: process of fitting a model to data.
• Inference: using the trained model to make predictions on new data.
• Features: input variables used by a model.
• Labels/targets: expected outputs for supervised learning.
2.2 Types of Machine Learning
, • Supervised learning: model learns from labeled data. Common tasks: classification and regression.
• Unsupervised learning: model finds structure in unlabeled data. Common tasks: clustering, dimensionality
reduction, anomaly detection.
• Semi-supervised learning: combines a small amount of labeled data with a large amount of unlabeled data.
• Reinforcement learning: an agent learns by interacting with an environment and receiving rewards or
penalties.
2.3 Common ML Algorithms
• Linear Regression — predicts continuous values such as sales, prices, or demand.
• Logistic Regression — classification algorithm for yes/no outcomes.
• Decision Trees — tree-structured rules; easy to interpret.
• Random Forest — ensemble of decision trees for stronger performance.
• Gradient Boosting / XGBoost / LightGBM — powerful models for tabular data.
• k-Nearest Neighbors (KNN) — predicts based on similar nearby examples.
• Support Vector Machine (SVM) — classification and regression with margin-based separation.
• K-Means — clustering algorithm for grouping similar data points.
• Principal Component Analysis (PCA) — dimensionality reduction and feature compression.
• Neural Networks / Deep Learning — layered networks used for language, image, audio, and complex
prediction tasks.
2.4 Deep Learning and Generative AI
• Deep Learning uses neural networks with many layers and large datasets.
• Convolutional Neural Networks (CNNs) are widely used for image recognition and computer vision.
• Recurrent Neural Networks (RNNs) and sequence models handle ordered data such as text and time
series; transformers now dominate many sequence tasks.
• Transformers are the foundation of modern large language models and many multimodal systems.
• Generative AI creates new text, images, code, audio, or video from learned patterns.
2.5 Typical AI/ML Workflow
• Define the problem and business objective.
• Collect and understand data sources.
• Clean, transform, and prepare data.
• Split data into training, validation, and test sets.
• Select model(s) and train them.
• Evaluate with appropriate metrics.
• Tune hyperparameters and improve features.
• Deploy the model into an application or pipeline.
• Monitor performance, drift, fairness, and reliability.
These notes provide a structured overview of modern technology and data-related fields. They cover foundations,
practical workflows, common tools, use cases, and current industry directions. The material is organized for
students, self-learners, and anyone preparing concise revision notes or a project file.
1. Introduction to Technology and Data
Technology is the application of scientific knowledge, engineering, and computational systems to solve problems.
Data is the raw material of the digital world: numbers, text, images, audio, logs, transactions, and sensor readings
that can be stored, processed, analyzed, and converted into decisions.
• Technology includes computers, software, networks, cloud platforms, automation, AI systems, cybersecurity
tools, and digital devices.
• Data refers to facts or observations collected from people, machines, applications, and environments.
• Information is processed data with meaning.
• Knowledge is insight gained from information and experience.
• Decision intelligence is the use of analytics, models, and business rules to guide actions.
Why Technology and Data Matter
• They power businesses, governments, healthcare, finance, education, e-commerce, entertainment, and
scientific research.
• Organizations use data to understand customers, optimize operations, reduce risk, automate work, and create
new products.
• Modern careers increasingly require digital literacy, programming awareness, and data interpretation skills.
2. Artificial Intelligence (AI) and Machine Learning (ML)
Artificial Intelligence is the broader field of building systems that perform tasks associated with human
intelligence, such as understanding language, recognizing patterns, reasoning, making recommendations, and
generating content. Machine Learning is a subset of AI in which systems learn patterns from data instead of
relying only on hand-written rules.
2.1 Core Concepts
• AI: umbrella field covering rule-based systems, search, planning, expert systems, robotics, NLP, computer
vision, and generative AI.
• ML: algorithms learn relationships from data to make predictions or decisions.
• Model: the mathematical representation learned from training data.
• Training: process of fitting a model to data.
• Inference: using the trained model to make predictions on new data.
• Features: input variables used by a model.
• Labels/targets: expected outputs for supervised learning.
2.2 Types of Machine Learning
, • Supervised learning: model learns from labeled data. Common tasks: classification and regression.
• Unsupervised learning: model finds structure in unlabeled data. Common tasks: clustering, dimensionality
reduction, anomaly detection.
• Semi-supervised learning: combines a small amount of labeled data with a large amount of unlabeled data.
• Reinforcement learning: an agent learns by interacting with an environment and receiving rewards or
penalties.
2.3 Common ML Algorithms
• Linear Regression — predicts continuous values such as sales, prices, or demand.
• Logistic Regression — classification algorithm for yes/no outcomes.
• Decision Trees — tree-structured rules; easy to interpret.
• Random Forest — ensemble of decision trees for stronger performance.
• Gradient Boosting / XGBoost / LightGBM — powerful models for tabular data.
• k-Nearest Neighbors (KNN) — predicts based on similar nearby examples.
• Support Vector Machine (SVM) — classification and regression with margin-based separation.
• K-Means — clustering algorithm for grouping similar data points.
• Principal Component Analysis (PCA) — dimensionality reduction and feature compression.
• Neural Networks / Deep Learning — layered networks used for language, image, audio, and complex
prediction tasks.
2.4 Deep Learning and Generative AI
• Deep Learning uses neural networks with many layers and large datasets.
• Convolutional Neural Networks (CNNs) are widely used for image recognition and computer vision.
• Recurrent Neural Networks (RNNs) and sequence models handle ordered data such as text and time
series; transformers now dominate many sequence tasks.
• Transformers are the foundation of modern large language models and many multimodal systems.
• Generative AI creates new text, images, code, audio, or video from learned patterns.
2.5 Typical AI/ML Workflow
• Define the problem and business objective.
• Collect and understand data sources.
• Clean, transform, and prepare data.
• Split data into training, validation, and test sets.
• Select model(s) and train them.
• Evaluate with appropriate metrics.
• Tune hyperparameters and improve features.
• Deploy the model into an application or pipeline.
• Monitor performance, drift, fairness, and reliability.