Course Outline
Introduction to Azure Data Factory
- Overview of Azure Data Factory
- Key concepts and architecture
- Use cases and benefits of ADF
Setting Up Your ADF Environment
- Creating and configuring an ADF instance
- Navigating the Azure Data Factory portal
- Understanding integration runtimes
Working with Datasets and Linked Services
- Defining datasets and linked services
- Connecting to different data sources
- Configuring authentication and secure connections
Creating Data Pipelines
- Pipeline basics and components
- Creating simple data pipelines with activities
- Building a pipeline for data movement
Data Flow and Transformation Activities
- Introduction to data flow
- Data transformation activities
- Designing and running data flow transformations
Scheduling and Triggering Pipelines
- Scheduling pipeline runs with triggers
- Using tumbling window and event-based triggers
- Monitoring pipeline activity and understanding output logs
Debugging and Error Handling
- Debugging pipelines and data flows
- Implementing error handling and retry mechanisms
- Adding error handling to existing pipelines
Performance Optimization
- Best practices for optimizing data pipelines
- Understanding and configuring parallelism and partitioning
- Optimizing pipeline performance
Security and Monitoring
- Securing ADF with access control and permissions
- Implementing data encryption and secure data transfer
- Monitoring data pipelines with built-in tools and alerts
Advanced Scenarios and Integration
- Integrating ADF with other Azure services
- Handling complex data integration scenarios
- Creating an end-to-end data integration solution
Summary and Next Steps
Requirements
- Basic knowledge of cloud computing concepts
- Familiarity with data integration and ETL processes
Audience
- Data engineers
- Data analysts
- ETL developers
- IT professionals
Custom Corporate Training
Training solutions designed exclusively for businesses.
- Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
- Flexible Schedule: Dates and times adapted to your team's agenda.
- Format: Online (live), In-company (at your offices), or Hybrid.
Price per private group, online live training, starting from 3200 € + VAT*
Contact us for an exact quote and to hear our latest promotions
Testimonials (2)
I've find out new interesting things about Lambda and Serverless
Oleg Buldumac - PUBLIC COURSE
Course - AWS Lambda for Developers
The training session was highly intensive and exceptionally well-structured. Eric provided us with comprehensive materials and practical labs featuring real-world examples, greatly enhancing our learning experience. We adhered closely to the planned schedule and efficiently skipped sections irrelevant to our interests. Eric demonstrated a high level of professionalism and extensive expertise, addressing all our questions thoroughly and effectively. Thank you very much for organizing this valuable training.
