Tutorial: Aarini Delta Extractor
This project is a flexible data pipeline designed to extract data from SAP systems. It can operate in two modes: either as a simple command-line tool for one-off jobs or as a full-fledged web API for managing complex, scheduled extractions. The tool supports pulling data through modern web protocols (HTTP/OData) or traditional direct connections (RFC). Once extracted, the raw data is transformed into optimized Parquet files and automatically uploaded to cloud storage, making it ready for analysis in data lakes or warehouses.
Source Repository: Delta Extractor
Chapters
- Extraction Entrypoint
- RFC-based Extraction Engine
- HTTP/OData-based Extraction Engine
- Data Transformation to Parquet
- Cloud Storage Uploader
- Database Metadata Model
- API & Orchestration Layer
Generated by AI Codebase Knowledge Builder