Data Science

Data Science

1. “The discipline of extracting knowledge from large volumes of data using techniques from statistics, computer science, and domain expertise.”

2. What is Data Science?

   • Combines: Programming, Statistics, Math Domain & Knowledge
   • Purpose: Discover patterns, Predict outcomes and Support decisions
   • In Margin Call, an analyst uses risk models and historical data to detect a portfolio collapse risk. In The Big Short, analysts use unconventional data (e.g., mortgage delinquencies) to predict the housing bubble burst.

3. Data Analytics vs. Data Science

   • Data Analytics
     • The process of examining raw data to draw conclusions and trends.
   • Data Science
     • Uses predictive models and machine learning to forecast future outcomes.

4. What is Big Data?

   • Extremely large datasets that traditional tools can't process efficiently.
     • Characteristics: Volume, Velocity, Variety, Veracity, Value, Variability
     • In The Big Short: Used “big data” trends to uncover housing market instability. Margin Call: Firm holds huge portfolios of mortgage-backed securities.

5. CRISP-DM Methodology

   • Industry-standard process for Data Science projects
     • 1. Business Understanding - Define problem Margin Call: “Will we collapse if we hold these assets?” Big Short: “Is the housing market about to implode?”
     • 2. Data Understanding - Collect and explore data Big Short: Investigating actual loan performance, not just models
     • 3. Data Preparation - Clean and transform data, Remove bias, noise, irrelevant fields
     • 4. Modeling - Choose algorithms Big Short: Model housing collapse using synthetic CDOs Margin Call: Use VaR (Value at Risk) modeling
     • 5. Evaluation Assess model effectiveness “Do our predictions make sense?”
     • 6. Deployment - Apply results to decision-making Margin Call: Dump toxic assets overnight Big Short: Investors place “shorts” against the housing market

6. How Data Science Relates to the Films

   • Risk Modeling (Data Science) Crucial to detecting financial collapse
   • Pattern Detection (Analytics) Reveal systemic flaws (e.g., bad mortgage loans)
   • Data-Driven Decisions - Margin Call: Based decisions on urgent model outputs - Big Short: Profited by interpreting the ignored data

Imagens e arquivos do mapa