Course Outline
Introduction to Azure Data Factory
- Overview of Azure Data Factory
- Key concepts and architecture
- Use cases and benefits of ADF
Setting Up Your ADF Environment
- Creating and configuring an ADF instance
- Navigating the Azure Data Factory portal
- Understanding integration runtimes
Working with Datasets and Linked Services
- Defining datasets and linked services
- Connecting to different data sources
- Configuring authentication and secure connections
Creating Data Pipelines
- Pipeline basics and components
- Creating simple data pipelines with activities
- Building a pipeline for data movement
Data Flow and Transformation Activities
- Introduction to data flow
- Data transformation activities
- Designing and running data flow transformations
Scheduling and Triggering Pipelines
- Scheduling pipeline runs with triggers
- Using tumbling window and event-based triggers
- Monitoring pipeline activity and understanding output logs
Debugging and Error Handling
- Debugging pipelines and data flows
- Implementing error handling and retry mechanisms
- Adding error handling to existing pipelines
Performance Optimization
- Best practices for optimizing data pipelines
- Understanding and configuring parallelism and partitioning
- Optimizing pipeline performance
Security and Monitoring
- Securing ADF with access control and permissions
- Implementing data encryption and secure data transfer
- Monitoring data pipelines with built-in tools and alerts
Advanced Scenarios and Integration
- Integrating ADF with other Azure services
- Handling complex data integration scenarios
- Creating an end-to-end data integration solution
Summary and Next Steps
Requirements
- Basic knowledge of cloud computing concepts
- Familiarity with data integration and ETL processes
Audience
- Data engineers
- Data analysts
- ETL developers
- IT professionals
Delivery Options
Private Group Training
Our identity is rooted in delivering exactly what our clients need.
- Pre-course call with your trainer
- Customisation of the learning experience to achieve your goals -
- Bespoke outlines
- Practical hands-on exercises containing data / scenarios recognisable to the learners
- Training scheduled on a date of your choice
- Delivered online, onsite/classroom or hybrid by experts sharing real world experience
Private Group Prices RRP from €4560 online delivery, based on a group of 2 delegates, €1440 per additional delegate (excludes any certification / exam costs). We recommend a maximum group size of 12 for most learning events.
Contact us for an exact quote and to hear our latest promotions
Public Training
Please see our public courses
Testimonials (4)
very friendly and helpful
Aktar Hossain - Unit4
Course - Building Microservices with Microsoft Azure Service Fabric (ASF)
The manual serverless setup. Also, I had no Idea sls web console exits, which is nice.
Rafal Kucharski - The Software House sp. z o.o.
Course - Serverless Framework for Developers
All good, nothing to improve
Ievgen Vinchyk - GE Medical Systems Polska Sp. Z O.O.
Course - AWS Lambda for Developers
IOT applications