Focus: Cognitive simulation, reasoning, and high-level logic.
Focus: Statistical learning, data patterns, and predictive modeling.
Focus: Process efficiency, industrial control, and software workflow.
{Link: .gitlab-ci.yml https://codefresh.io/learn/gitlab-ci/what-is-the-gitlab-ci-ydml-file-and-how-to-work-with-it/} file in your repository to define pipelines, which are executed by GitLab Runner);Focus: Physical systems, mechanics, and embodied intelligence.
To reach the full depth of mannier- points for each field, we must move beyond general concepts into specialized sub-architectures, specific sensor types, industrial standards, and the mathematical "nuts and bolts" that drive these systems.
Artificial Intelligence (AI)
Continued: Specialized Logic, Knowledge Engineering, and Advanced NLP
- Neuro-symbolic AI;
- Meta-reasoning;
- Case-based Adaptation;
- Explanation Generation;
- Knowledge Acquisition Bottleneck;
- Truth Maintenance Systems;
- Semantic Web {RDF (Resource Description Framework Schema)/OWL (Web Ontology Language)}[are W3C-standardized data modeling languages designed for the Semantic Web to describe knowledge in the form of RDF data. While RDF/RDFS provides a basic framework for creating taxonomies and class hierarchies, OWL offers much higher expressiveness, allowing for complex logical constraints, reasoning, and richer data modeling];
- Description Logics;
- Situation Calculus;
- Fluent Logic;
- Non-monotonic Inheritance;
- Default Logic;
- Circumscription;
- Autoepistemic Logic;
- Modal Logic in Artificial Intelligence;
- Belief Revision {AGM (Alchourrón, Gärdenfors, Makinson) framework}[ Contraction, Expansion, Revision, Consolidation and Merging];
- Computational Linguistics;
- Discourse Markers;
- Anaphora Resolution;
- Textual Entailment;
- Vector Space Models;
- Latent Semantic Analysis (LSA);
- Latent Dirichlet Allocation (LDA);
- Transformer-XL;
- Flash Attention;
- Quantization-Aware Training;
- Knowledge Distillation;
- Mixture of Experts (MoE);
- Sparse Transformers;
- Long-form Question Answering;
- Fact-checking Artificial Intelligence;
- Hallucination Detection;
- Multi-modal Alignment {Contrastive Language-Image Pre-training (CLIP)}[CLIP (Contrastive Language-Image Pre-training) is a pioneering multimodal AI model developed by OpenAI that aligns text and images into a shared, 512-dimensional vector space. By training on massive datasets of image-text pairs, it learns to embed corresponding images and texts near each other, while pushing dissimilar ones apart. This allows CLIP to perform zero-shot classification and cross-modal retrieval (e.g., finding an image based on a text description) by measuring cosine similarity between the embeddings] Artificial Intelligence Model;
- Contrastive Language-Image Pre-training;
- Visual Question Answering (VQA);
- Artificial Intelligence Governance Frameworks;
- Algorithmic Impact Assessments;
- Red Teaming for Artificial Intelligence;
- Jailbreak Defense;
- Constitutional Artificial Intelligence;
- Reinforcement Learning from Human Feedback [(RLHF) {is a machine learning technique that improves AI models by incorporating direct human evaluations into the training process, typically used to align Large Language Models (LLMs) with human values. By using human feedback to train a reward model, RLHF optimizes model outputs to be more helpful, honest, and harmless, rather than relying solely on automated metrics}];
- Direct Preference Optimization [(DPO) {is a stable, efficient method for aligning Large Language Models (LLMs) with human preferences by directly optimizing the model on preference data (preferred vs. rejected responses). It eliminates the need for complex reinforcement learning (RL) and separate reward models, making it faster and more stable than traditional RLHF}];
- Proximal Policy Optimization [(PPO) {is a popular, reliable, and efficient Reinforcement Learning (RL) algorithm that simplifies complex policy gradient methods by using a clipped surrogate objective. It stabilizes training by preventing excessively large policy updates, ensuring the new policy stays close to the old one}];
- Value Alignment;
- Instrumental Convergence;
- Orthogonality Thesis;
- Singularitarianism;
- Turing Completeness in Artificial Intelligence;
- Von-Neumann Architecture vs Neural;
- Neuromorphic Computing;
- Embodied Cognition;
- Active Inference;
- Free Energy Principle;
- Predictive Coding;
- Global Workspace Theory;
- Integrated Information Theory;
- Computational Creativity;
- Procedural Content Generation;
- Artificial Intelligence in Drug Discovery;
- Protein Folding (AlphaFold);
- Legal Reasoning Artificial Intelligence;
- Judicial Analytics;
- Algorithmic Trading;
- High-Frequency Trading Artificial Intelligence;
- Smart Grid Optimization;
- Precision Agriculture Artificial Intelligence;
- Climate Modeling Artificial Intelligence;
- Disaster Response Artificial Intelligence;
- Cybersecurity (Anomaly Detection) Artificial Intelligence;
- Malware Classification;
- Phishing Detection Artificial Intelligence;
- Deepfake Detection;
- Watermarking AI Content;
- Differential Privacy in Artificial Intelligence;
- Federated Learning Orchestration;
- Swarm AI;
- Collective Intelligence;
- Human-in-the-loop {(HITL) is an Artificial Intelligence approach that integrates human interaction into machine learning, combining algorithmic efficiency with human judgment, expertise, and ethical reasoning. It enhances model accuracy, safety, and reliability by involving humans in training, evaluation, and operational decision-making, particularly in complex scenarios};
- Active Learning Query Strategies;
- Curriculum Learning;
- Multi-task Optimization;
- Transfer Learning (Inductive);
- Transfer Learning (Transductive);
- Domain Adaptation;
- Covariate Shift;
- Concept Drift Detection;
- Online Learning Regret;
- PAC {Probably Approximately Correct learning is a theoretical framework introduced by Leslie Valiant in 1984 that defines when a machine learning algorithm can reliably learn a concept. It ensures that with high probability ( ), a model trained on a finite set of samples will have a low generalization error ( ). It establishes bounds on sample complexity and model accuracy} Learning;
- VC Dimension {The Vapnik-Chervonenkis dimension is a measure of the capacity (complexity, expressive power, or flexibility) of a statistical classification model, defined as the maximum number of data points,
, that can be "shattered" (correctly classified for all possible labelings) by the model. It indicates how well a classifier can fit diverse data configurations};
- Computational Complexity of Artificial Intelligence;
- P vs NP in AI Search;
- Quantum Machine Learning;
- Quantum Gates in AI;
- Variational Quantum Eigensolvers;
- Artificial Intelligence for Quantum Error Correction;
- Synthetic Biology Artificial Intelligence;
- DNA Computing;
- Wetware Artificial Intelligence;
- Biological Neural Networks;
- Post-Humanism Ethics.
Machine Learning (ML)
Continued: Deep Mathematics, Feature Spaces, and MLOps
- Backpropagation through time (BPTT);
- Vanishing Gradient Problem;
- Exploding Gradient Problem;
- Gradient Clipping;
- Learning Rate Schedules;
- Nesterov Accelerated Gradient;
- Adagrad;
- AdaDelta;
- AdamW;
- Lookahead Optimizer;
- Second-order Optimization;
- Hessian Matrices;
- Jacobian Matrices in Machine Learning;
- Fisher Information Matrix;
- Kullback-Leibler Divergence;
- Jensen-Shannon Divergence;
- Earth Mover’s Distance (Wasserstein);
- Hinge Loss;
- Huber Loss;
- Log-Cosh Loss;
- Triplet Loss;
- Contrastive Loss;
- Focal Loss;
- Dice Coefficient;
- Jaccard Index;
- Bagging (Bootstrap Aggregating);
- Out-of-bag Error;
- Random Subspace Method;
- Feature Importance (SHAP);
- LIME (Local Interpretable Model-agnostic Explanations);
- Permutation Importance;
- Partial Dependence Plots;
- Individual Conditional Expectation;
- Calibration (Platt Scaling);
- Isotonic Regression;
- Precision-Recall Trade-off;
- Harmonic Mean;
- Matthews Correlation Coefficient;
- Log Loss;
- Brier Score;
- Gini Impurity;
- Information Gain;
- Entropy;
- Chi-Square for Feature Selection;
- ANOVA for Feature Selection;
- Recursive Feature Elimination;
- Principal Component Analysis (PCA);
- Singular Value Decomposition (SVD);
- Independent Component Analysis;
- Factor Analysis;
- Isomap;
- Locally Linear Embedding;
- Uniform Manifold Approximation and Projection {(UMAP) is a fast, non-linear dimensionality reduction algorithm used for visualizing high-dimensional data in 2D or 3D while preserving both local neighborhoods and global structure. It outperforms t-SNE in speed and structure preservation, making it ideal for large datasets, clustering, and bioinformatics};
- Kernel Trick;
- Mercer’s Theorem;
- Hyperplane Margin;
- Slack Variables;
- K-means++;
- Elbow Method;
- Silhouette Score;
- Dendrograms;
- Cophenetic Correlation;
- Market Basket Analysis;
- Apriori Algorithm;
- Eclat Algorithm;
- Frequent Pattern Growth {(FP-Growth) is a highly efficient data mining method used to discover frequent itemsets in large datasets without costly candidate generation, unlike the Apriori algorithm. It compresses database transactions into a tree structure (FP-tree), requiring only two scans of the data to extract patterns} Algorithm;
- Collaborative Filtering;
- Content-based Filtering;
- Cold Start Problem;
- Matrix Factorization;
- Neural Collaborative Filtering;
- Recommender Hybrid Systems;
- Multi-armed Bandits;
- Upper Confidence Bound (UCB);
- Thompson Sampling;
- Markov Chain Monte Carlo (MCMC);
- Gibbs Sampling;
- Metropolis-Hastings;
- Variational Inference;
- Expectation-Maximization {(EM) is an iterative optimization method used in machine learning and statistics to find maximum likelihood or Maximum A Posteriori (MAP) estimates of parameters in models that depend on unobserved latent variables. It alternates between an E-step (estimating missing data/hidden variables) and an M-step (optimizing parameters) to maximize the likelihood function, commonly used in Gaussian Mixture Models and clustering} Algorithm;
- Latent Variables;
- Mixture Models;
- Hidden Markov Models (HMM);
- Viterbi Algorithm;
- Forward-Backward Algorithm;
- Baum-Welch Algorithm;
- Conditional Random Fields {(CRF) are undirected probabilistic graphical models used for segmenting and labeling structured data, such as sequences in NLP (POS tagging, NER) and computer vision. As discriminative models, they model the conditional probability of labels given observations, allowing for flexible, overlapping features. CRFs outperform HMMs and MEMMs by overcoming label bias and utilizing global normalization} Models;
- Structural Risk Minimization;
- Empirical Risk Minimization;
- No Free Lunch Theorem;
- Occam’s Razor in Machine Learning;
- Reproducible Machine Learning;
- Model Pruning {(Magnitude-based) Magnitude-based pruning is a model compression technique in machine learning that reduces the size and computational complexity of a neural network by removing individual weights (unstructured) or entire structures (structured) with the smallest absolute values. It operates on the principle that weights with low magnitude contribute minimally to the network's output, making them safe to set to zero} Compression Technique;
- Weight Sharing;
- Low-rank Factorization;
- Quantization (Post-training);
- Quantization (Aware Training);
- ONNX [(Open Neural Network Exchange) is an open-source, vendor-agnostic ecosystem designed to standardize machine learning models, enabling seamless interoperability between different frameworks {e.g., https://pytorch.org/, https://www.tensorflow.org/, scikit-learn}. Founded by Microsoft and Facebook in 2017, it facilitates efficient, high-performance inference by allowing models to be trained in one environment and deployed on varied hardware];
- MLflow Tracking {is a component of the MLflow platform designed to log, organize, and query machine learning experiments. It allows users to record parameters, metrics, code versions, and artifacts (output files) during training, which can be visualized through a UI to compare results and ensure reproducibility};
- TensorFlow Extended {(TFX) are a specialized, modular framework designed to build and manage production-scale machine learning (ML) workflows. A TFX pipeline is essentially a Directed Acyclic Graph (DAG) of components that automates the entire ML lifecycle, including data ingestion, validation, feature engineering, model training, evaluation, and deployment} Pipelines Modular Framework;
Automation
Continued: Orchestration, Protocols, and System Reliability
- Event-Driven Architecture;
- Pub/Sub Messaging;
- Message Queues (RabbitMQ);
- Stream Processing (Kafka);
- Microservices Automation;
- Serverless Computing (AWS Lambda);
- Function-as-a-Service (FaaS);
- Docker Swarm;
- Kubernetes Pods;
- Helm Charts;
- Service Mesh (Istio);
- Blue-Green Deployment;
- Canary Releases;
- Chaos Engineering;
- Automated Log Rotation;
- Centralized Monitoring (Prometheus);
- Visual Dashboards (Grafana);
- Synthetic Monitoring;
- Real User Monitoring;
- Self-healing Systems;
- Automated Incident Response;
- PagerDuty Integration;
- SlackOps/ChatOps {facilitates a "conversation-driven development" model, where IT operations and DevOps tasks are executed directly within Slack channels using chatbots and slash commands. It acts as a central hub connecting people, tools, and processes to streamline workflows, such as deployment, incident management, and infrastructure monitoring};
- Robotic Desktop Automation {(RDA) often called attended automation, uses software bots on individual employee desktops to automate repetitive tasks, such as data entry, application navigation, and report generation in real-time. Unlike unattended RPA, RDA requires human initiation or intervention, acting as a virtual assistant to improve speed, accuracy, and employee productivity};
- Screen Scraping {(Legacy) is a legacy data extraction technique that captures visual information (pixels or text) directly from an application's user interface, rather than using APIs or structured data sources. Primarily used for liberating data from outdated systems, it acts as a "wrapper" to modernize older applications, enable data migration, and streamline workflows by automating manual data entry};
- Optical Character Recognition (OCR) for Robotic Desktop Automation;
- Natural Language Processing for Robotic Desktop Automation;
- Attended Automation;
- Unattended Automation;
- Automation Center of Excellence {(CoE) is a centralized, specialized team that drives the strategy, governance, and implementation of automation technologies like RPA, AI, and intelligent workflows to scale productivity. It establishes best practices, standards, and reusable templates to ensure consistent, high-value ROI};
- Process Mining;
- Task Mining;
- Business Process Management {(BPM) is a systematic, ongoing discipline that analyzes, models, optimizes, and automates business workflows to improve efficiency, agility, and performance. It serves as a, strategic approach to align business processes with organizational goals, enabling digital transformation through the continuous improvement of operations and reduction of bottlenecks};
- Low-Code Platforms;
- No-Code Platforms;
- API Rate Limiting;
- Webhooks;
- OAuth2 Automation {streamlines API authorization by programmatically handling access token acquisition, usage, and renewal, eliminating manual login steps. It involves automating the exchange of credentials (client ID/secret) or user authorization codes for short-lived access tokens, often using tools like Postman, Python, or CI/CD pipelines to manage token lifecycles};
- Automated SSL Management;
- Database Schema Migration;
- Automated Code Audits;
- Static Analysis Tools;
- Dynamic Analysis Tools;
- Container Scanning;
- Automated Compliance {(SOC2) uses software(s) like "Vanta, Secureframe, Sprinto, Scrut Automation and Drata" to streamline, monitor, and manage security controls, replacing manual, spreadsheet-based processes with continuous, real-time evidence collection. By integrating with existing tech stacks, these platforms reduce audit prep time by 25-50%, prevent human errors, and ensure continuous security monitoring};
- Financial Close Automation;
- Accounts Payable Automation;
- Payroll Automation;
- Automated Trading Systems;
- Smart Contracts (Solidity);
- DeFi Automation;
- Blockchain Oracles;
- Home Automation (Zigbee);
- Z-Wave Protocols;
- Matter Protocol;
- Industrial Gateways;
- OPC-UA Security;
- Profinet RT/IRT;
- DeviceNet;
- CANopen;
- LonWorks;
- BACnet;
- KNX;
- DALI Lighting;
- Modbus TCP/RTU;
- WirelessHART;
- ISA100.11a;
- LoRaWAN for Automation;
- NB-IoT;
- 5G Network Slicing for Industry;
- Edge Gateway Processing;
- Fog Computing;
- Digital Continuity;
- Product Lifecycle Management (PLM);
- Computer-Aided Design (CAD) Automation;
- CAM (Computer-Aided Manufacturing);
- Computer-Integrated Manufacturing (CIM);
- Automated Guided Vehicles (AGV) Control;
- Autonomous Mobile Robots (AMR) Fleet;
- Pick-to-Light Systems;
- Voice-Directed Picking;
- Automated Sorting Systems;
- Parcel Singulation;
- Automated Palletizing;
- Depalletizing Robots;
- Stretch Wrapping Automation;
- Print-and-Apply Systems;
- RFID Sorting {(Radio Frequency Identification Device) sorting is an automated identification process using radio waves to track, categorize, and sort objects (parcels, linens, products) attached with RFID tags. An RFID reader/tunnel scans tags on a conveyor, sending data to a PLC to control mechanisms like robotic arms, pushers, or tilt trays for accurate sorting. It increases efficiency and speed over manual methods, used in warehouses, libraries, and recycling};
- AS/RS Cranes;
- Vertical Lift Modules (VLM);
- Multi-shuttle Systems;
- Automated Quality Control (AQC);
- Non-Destructive Testing (NDT);
- Automated Optical Inspection (AOI);
- X-Ray Inspection Automation;
- Leak Detection Automation;
- Remote Monitoring & Management (RMM);
- IT Asset Management (ITAM);
- Mobile Device Management (MDM);
- Zero-Trust Automation.
Robotics
Continued: Control Theory, Advanced Hardware, and Kinematics
- Denavit-Hartenberg (D-H) Parameters;
- Homogeneous Transformation Matrices;
- Quaternion Orientation;
- Euler Angles;
- Gimbal Lock;
- Singularity Avoidance;
- Redundant Manipulators;
- Null Space Control;
- Operational Space Control;
- Cartesian Control;
- Joint Space Control;
- Proportional-Integral-Derivative {(PID) Loop Tuning (Ziegler-Nichols) The Ziegler-Nichols (Z-N) method is an empirical closed-loop technique for tuning PID controllers by setting and gains to zero, increasing Proportional Gain (Kp) until sustained oscillations occur, then using the Ultimate Gain (Ku) and Ultimate Period (Pu) to calculate controller settings for aggressive disturbance rejection} Controller;
- Feed-forward Control;
- Disturbance Observers;
- Model Predictive Control (MPC);
- Robust Control;
- Adaptive Control;
- Sliding Mode Control;
- H-infinity Control;
- Optimal Control (LQR);
- Dynamic Programming for Robots;
- State-Space Representation;
- Controllability;
- Observability;
- Kalman Filter Fusion;
- IMU/GPS Integration;
- Visual Odometry;
- Wheel Odometry;
- Slip Detection;
- Traction Control;
- Torque Vectoring;
- Active Suspension;
- Strain Gauges;
- Piezoelectric Actuators;
- Shape Memory Alloys (SMA);
- Electroactive Polymers (EAP);
- Magnetorheological Fluid;
- Series Elastic Actuators (SEA);
- Variable Stiffness Actuators;
- Direct-Drive Motors;
- Frameless Motors;
- Harmonic Drive Ratios;
- Backlash Compensation;
- Friction Modeling;
- Cogging Torque;
- Thermal Management in Motors;
- Regenerative Braking;
- Power Density;
- Energy Harvesting;
- Supercapacitors for Robots;
- LiPo vs LiFePO4 for Drones;
- Wireless Power Transfer;
- Human-Robot Collaboration (HRC);
- Collaborative Workspace Design;
- Speed and Separation Monitoring;
- Hand Guiding Modes;
- Power and Force Limiting (PFL);
- Safety Integrity Level (SIL);
- Performance Level (PL);
- ISO 10218 Standards;
- ISO/TS 15066;
- Surgical Robot Accuracy;
- Haptic Interfaces;
- Master-Slave Latency;
- Tele-presence Robots;
- Social Robotics;
- Facial Expression Synthesis;
- Natural Language for Robots;
- Gesture Recognition;
- Swarm Robotics (Boids Model);
- Decentralized Coordination;
- Bio-inspired Design;
- Biomimicry (Gecko Feet, Shark Skin);
- Soft Robotics (Fluidic Elastomer Actuators);
- Jamming Grippers;
- Underactuated Hands;
- Micro-Robotics;
- Nano-Robotics;
- MEMS (Micro-Electro-Mechanical Systems);
- Space Robotics (RADA Hardening);
- Lunar Rovers;
- Martian Drills;
- Orbital Maintenance Robots;
- Search and Rescue Robotics;
- Snake Robots;
- Climbing Robots;
- Trenchless Pipe Robots;
- Agricultural Weeding Robots;
- Milking Robots;
- Fruit Picking End-Effectors;
- Food-Safe Robotics (IP69K);
- Cleanroom Robotics;
- Explosive Ordnance Disposal (EOD);
- Nuclear Decommissioning Robots;
- Disaster Mapping (Drones);
- Photogrammetry;
- Point Cloud Processing;
- Mesh Generation;
- Digital Twin Synchronization;
- Robot Life-Cycle Assessment.