2023/03/02: ETL Tools, ViT, Dunning-Kruger effect, Foundation Model 용어의 기원 등

1. A List of the 16 Best ETL Tools And Whay To Choose Them

source: https://www.datacamp.com/blog/a-list-of-the-16-best-etl-tools-and-why-to-choose-them

What is ETL

• Exatracting data from sources
• Transforming data into data models
• Loading data into data ware houses

The Top 16 ETL Tools Data Teams Can Consider

• Informatica PowerCenter
• Apache Airflow
• IBM Infosphere Datastage
• Oracle Data Integrator
• Microsoft SQL Server Integration Services (SSIS)
• Talend Open Studio (TOS)
• Pentaho Data Integration (PDI)
• Hadoop
• AWS Glue
• AWS Data Pipeline
• Azure Data Factory
• Google Cloud Dataflow
• Stitch
• SAP BusinessObjects Data Services
• Hevo
• Qlik Compose

2.Scaling Vision Transformers to 22 Billion Parameters

source: https://arxiv.org/pdf/2302.05442.pdf

From 4B to 22B parameters, ViT demonstrates increasing performance with scale

3.Dunning-Kruger effect

source: https://www.linkedin.com/posts/dario-sannino-2ab71479_the-dunning-kruger-effect-is-as-follows-activity-7034870775824195584-P88R?utm_source=share&utm_medium=member_desktop

• Duning-kruger 효과
  • "People with low skill levels draw wrong conclusions and make wrong decisions, but are unable to make mistakes because of their low skill levels".
  • 의미: 실수에 대한 이해가 부족하면 자신의 정확성에 대한 믿음이 생기고 결과적으로 자신의 결정과 자신에 대한 자신감이 높아지므로 자신의 우월성에 대한 인식이 높아진다.

4. Foundation Models are Creating the Industrial Era of AI

source: https://jrodthoughts.medium.com/foundation-models-are-creating-the-industrial-era-of-ai-212bcbcfbbd8

Foundation Model의 기원

• 최초로 스탠포드에서 사용됨 : Reflections on Foundation Models
  • On the Opportunities and Risks of Foundation Models
  • https://arxiv.org/pdf/2108.07258.pdf

Foundation Model 도입으로 인한 AI 애플리케이션의 몇가지 근본 변화

• 인프라스트럭처에서 App으로 가치가 이동함
• 지능형 app은 모델보다 제품에 관한 것임
• 파인튜닝 vs 새모델