Extract-Transform-Load (ETL) Platform System
An Extract-Transform-Load (ETL) Platform System is a data processing system that can solve ETL tasks.
- Context:
- It can range from (typically) being based on a 3rd-Party ETL Platform to being a Custom ETL System.
- It can (typically) have ETL Platform System Capabilities.
- It can be a Domain-Specific System, such as a Log File ETL System.
- …
- Example(s):
- PlayStation's ETL Platform.
- Medable's ETL Platform.
- one build on Informatica PowerCenter, Apache Spark, or Apache Flume.
- …
- Counter-Example(s):
- See: Data Warehouse System, Data Streaming System.
References
2013a
- http://en.wikipedia.org/wiki/Category:ETL_tools
- Extract, transform, load tools are software packages that facilitate the performing of ETL tasks.
2013b
- http://en.wikipedia.org/wiki/Extract,_transform,_load#Tools
- Programmers can set up ETL processes using almost any programming language, but building such processes from scratch can become complex. Increasingly, companies are buying ETL tools to help in the creation of ETL processes.[1]
By using an established ETL framework, one may increase one's chances of ending up with better connectivity and scalability[citation needed]. A good ETL tool must be able to communicate with the many different relational databases and read the various file formats used throughout an organization. ETL tools have started to migrate into Enterprise Application Integration, or even Enterprise Service Bus, systems that now cover much more than just the extraction, transformation, and loading of data. Many ETL vendors now have data profiling, data quality, and metadata capabilities. A common use case for ETL tools include converting CSV files to formats readable by relational databases. A typical translation of millions of records is facilitated by ETL tools that enable users to input csv-like data feeds/files and import it into a database with as little code as possible.
ETL Tools are typically used by a broad range of professionals - from students in computer science looking to quickly import large data sets to database architects in charge of company account management, ETL Tools have become a convenient tool that can be relied on to get maximum performance. ETL tools in most cases contain a GUI that helps users conveniently transform data as opposed to writing large programs to parse files and modify data types - which ETL tools facilitate as much as possible.
- Programmers can set up ETL processes using almost any programming language, but building such processes from scratch can become complex. Increasingly, companies are buying ETL tools to help in the creation of ETL processes.[1]