2017-12-NTI-SAMEH El-ANSARY

26 Pages·2017·1.89 MB·English

Big Data in Egypt, Hype or Reality?
Sameh El-Ansary, PhD
(Teacher of What’s not BigData)
About Sameh El-Ansary
• Researcher:
– PhD in Large-Scale Distributed Systems, KTH, SWEDEN
– Researcher at the Swedish Institute of Computer Science, SICS
• Teacher:
– KTH: P2P, Distributed Algorithms
– Nile University: Security, SwEng, Network Programming, BigData. Designed
the 1st professional diploma in BigData and Data Science in Egypt
• Entrepreneur:
– Co-founder of Hive Streaming (successful exit): P2P live streaming for
corporates. Used by global corporation like: Facebook, Ericsson, PepsiCo and
Kellogg’s
– Co-founder of Scalable-Learning: Help universities compete with MOOCs
– Co-founder of Racefox: AI coach for Skiing, Running
– Founder of Novelari Innovation Accelerator: Helping Swedish & Egyptian
startups with hard technical questions and business-focused development in
areas like: Cloud Architecture, Big Data, AI and Data Science.
How every talk on BigData Starts?
• Big Data is booming!!
• Big Data is the future!!
• You should learn BigData Engineering!!
• BigData jobs are increasing!!
• You should use BigData tools in your
corporate!!
• You should make a BigData startup!!
• !!
• !!
• !! …
So.. Is all this “!!” real?
• Mmm ..., YES, it is a multi-billion dollar industry
• It is a skill in high-demand all over the world
ME
• The question is: “Is knowing/using Big Data good for ?”
– A fresh computer science/IT graduate
– A fresh engineering graduate
– A corporate/startup junior developer
– A corporate/startup senior db/warehouse professional
– Network administrator
– Someone in another field, engineering, chemistry, medicine and looking to change
career?
• For all of the above?
The hype can
– NO, NO, NO and for some, it is hype and
affect you negatively!!
This Talk
• Is not about the greatness of BigData
Engineering, I trust the rest of the
workshop in showing this.
• Its is about sharing experience of
Egyptian/European students,
professionals, companies who decided to
got into the BigData field
• The talk is subjective, based on my
personal sample space
And..
• Before we start…
– We do not learn BigData…
– We learn BigData Engineering, Tools, and
Analytics
DATA SCIENCE OR
ENGINEERING?
Data Science Vs (Big)Data Eng.
Data Science Big Data Engineering
Maths and algorithmic skills Programming and Systems Skills
Science + Bit of tech Technology
Won’t change Will definitely change
Vendor/Tech-agnostic Vendor-specific
Needed for Real life apps Needed for Real life apps
Goal Tool
Relevant for Big or Small Data Relevant for Big Data Only
Extracting insights/value Solving scalability, heterogeneity, etc..
R, PyData, Visualization Hadoop, Spark, etc..
Regression, Classification, Wordcount, Indexing, ML at scale
Clustering, Neural Netowkrs, etc..
Needs data engineering to scale Helps Data Science
Let’s Play: Data Sci or Eng?
• Predicting the sales of next year
• Scaling up/out a data warehouse
• Detecting credit card fraud from logs
• Credit worthiness evaluation
• Building data models for OLAP
BIG DATA – AN ENGINEERING
PERSPECTIVE