Python Project for Data Engineering

Project Overview

This project is provided by IBM Developer Skill Network as part of the Python Project for Data Engineering course on Coursera. In this project, the skills and knowledge of basic Python and data engineering principles acquired throughout the course will be applied.

The task involves working with real-world data to perform Extraction, Transformation, and Loading (ETL) operations. The project scenario involves a multi-national firm that requires data engineering services to access, process, and transform data according to specific requirements.

The data for this project will be obtained through web scraping using Python's Requests API from a public website. The goal is to compile a list of the top 10 largest banks globally based on their market capitalization, measured in billion USD.

Once this initial data is extracted, it will be transformed into three additional currencies: GBP, EUR, and INR. The exchange rates necessary for this transformation will be sourced from a CSV file. After the transformation, the data will be saved locally in a CSV format, allowing for easy access and viewing.

Additionally, the transformed data will be loaded into a database table, enabling managers from different countries to query the database and retrieve market capitalization values in their local currency, facilitating informed decision-making and analysis.