PASS Summit 2016 Day Two Keynote

9:15
Describing the architectures. I am going to stop for today. I have a book signing at 10 and the WIT luncheon later today.

9:11
Unique fault tolerance approach

9:05
Talking about column store, sorting.

9:04
Now execution time increases by 1/3 with 4 nodes instead of doubling.

9:03
Divide rows across all other nodes.

9:02
Execution time will double even with a 100 node system. It’s like partition skew since one node will do double the work.

9:01
Mirror data to another node. One node can fail. Execution time will double.

9:00
Handling Hardware errors
Node failures with shared-nothing. Mirroring is not sufficient.

8:58
Explaining shuffling. This is familiar if you have worked with PDW/APS.

8:54
Joins, four cases depending on how tables are partitioned or replicated. Shuffling in some cases.

8:53
Explaining how a table is executed on all nodes. Same query plan runs on nodes.

8:49
Partitioned parallelism.

8:48
Table replication. Tables are completely replicated on every node of the cluster.

8:47
Can lead to skew

8:46
There is no way to know where a row ends up. Hash key partitioning. Use hash key to determine where rows land.

8:46
Round-robin partitioning. Rows are distributed among storage units. All disks end up with the same number of rows.

8:45
Both shared and shared nothing use partitioned tables. This is the key to parallel processing. What does orthogonal mean?

8:44
Partitioned tables
Basis for scalable execution. Distribute the rows of the table across storage devices.

8:43
Network can limit scaling.

8:42
Shared-Storage
Remote storage, data is separated from compute. Local disks for tempdb.

8:41
Shared-Nothing
Commodity servers and commodity networking. Storage and compute are co-located. Scales indefinitely.

8:40
APS and Azure DW are same software in different hardware form factors.

8:38
Two alternative scalable dw designs
Shared-nothing appliances such as APS
Shared-storage Oracle RAQ, Microsoft SQL DW

8:36
Scalable DW Fundamentals
Partitioned tables, but I think he means distributed tables??

8:35
Appliance is always best performing. Cloud is low cost.
Cloud – no CapEx low OpEx. Conception to insight in hours. Flexibility to scale.

8:34
Now, DW in the cloud.

8:33
DW Appliance, low compliance but high costs. OR roll your own with lots of complexity. That was what available in 2008.

8:32
What is driving datawarehousing. Cheap hardware and increasing amounts of data.

8:31
#bringbackRima

8:20
Time for David DeWitt. Our favorite keynote speaker!

8:28
Today is WIT lunch with Kelly Lockwood Primus. Tonmorrow is board Q&A. Speaker Idol round 2. Fill out your evals!

8:27
New website coming 2017

8:26
We connect, share, and learn. New Brand!

8:25
It’s a place that allows us to share. PASS brand was created in 1999

8:24
Denise McInerney. Our focus has shifted to the entire data platform. What does PASS mean to us.

8:23
Microsoft is our biggest sponsor. We have several Global Alliance Partner including SentryOne and Redgate!

8:22
To much to keep up with. Chapters, VCs, more.

8:21
Around 50% in North America.

8:20
We are one global community. We are growing around the world. SQL Saturday events continue to grow.

8:19
Financial stuff…
We include 87% of the countries of the world in our membership.

8:18
Grant Fritchey on the stage.

8:17
At least the guys wearing kilts are not also wearing high heels.

8:16
This is Kilt Day.

8:00
I am back at the blogging table for day 2.

Posted in Uncategorized | Leave a comment

PASS Summit 2016 Day 1 Keynote

10:01
Lights are coming up. It’s time to rock!

10:00
Video. Blind person. Smart Glasses tell him what is going on around him. Tells who is around and their emotions. Take a picture of the menu. It tells him hot to hold phone and helps him navigate the menu.

9:59
Three patters of intelligence. Go try them out. Confluence of cloud, data and intelligence.

9:58
Can start to predict where the Pokémon are. Power BI, Azure SQL Database, R, Machine Learning.

9:57
Using R to create visualization. Deploying a tabular module to a URL! Data is in the cloud not a database.

9:56
What is the activity for each Pokémon? Where are the Pokémon?

9:55
Pokémon Go will be in the demo.

9:54
Demo from Jen Stirrup!!!!! Data Whisperer!!

9:53
Python tools for VS. R tools for VS. Azure Jupyter notebooks.

9:52
Redgate Data Platform Studio for Fully automated migrations.

9:51
New tools for upgrades. SQL Server migration assistant, data migration assistant, data experimentation assistant.

9:50
New algorithms in R.

9:48
Keeps power flowing.

9:47
Connected Drone video. Power line inspections.

9:46
Deep learning. Customer story Eastmark systems.

9:45
The power of the intelligent lake
Super-elastic DW. BI at the speed of thought
Big cognition

9:44
What if this was applied to all books?

9:43
Us to keep track of which books characters are in. Graph to see how characters are feeling. Heat map, trace emotions of key characters.

9:42
Build an interactive guide on top of results.

9:41
Sentiment analysis. Join key phrases to sentiments.

9:40
War and Peace. It is hard to keep track of the characters. It is unstructured data.

9:39
Intelligent queries using a SQL language U-SQL.

9:38
Julie Koesmarno up next to demo.

9:37
The How-Old.net app, captioning captionbot.ai.

9:36
Cognitive Services APIs. Very advanced tasks.

9:35
Bring your own intelligence, python, R.

9:34
3 data lake services. Hyper-scale storage optimized for analytics. Big data queries as a services. HDInsight clusters as a service.

9:33
Connect any tool. This is the tabular model. Extremely fast. Patabyte scale. Use Power Bi Session after this demonstrates this solution.

9:32
Azure Analysis Services in preview!!!! Pay for what you need, scale up and down. Bring in any data source.

9:31
Free trial of Azure SQL Data Warehouse.

9:30
No one wakes up and thinks about price of an electron.

9:29
Need to visualize the data.

9:28
Price of energy changes every 5 minutes.

9:27
The electric grid. One-directional power for 100 years. Now the data is flowing multiple ways. Consumers are also producers.

9:26
Scott Smith Integral Analytics.

9:25
Video. Stop, scale up, scale down.

9:24
Petabytes of data with analytics. Four services on Azure. Azure SQL Data Warehouse. It is a true elastic data warehouse.

9:23
Intelligent Lake. The rice equations. 40 ZB in 2020, much from sensors. An earth size rice bowl.

9:21
The game has new versions, but they don’t have to care about schema changes.

9:20
Showing a globe that shows where the matches are made. It is pretty busy out there.

9:19
1.9 M matches made each day. Matches between players to play games.

9:18
They are a small team but have pulled off a global game. 120 Gb of new data each day. 11,500 DocumentDB requests per second. 43 M walkers eliminated each day.

9:17
This is the official game of the Walking Dead. The show and game are integrated.

9:16
Showing us a video Season 7.

9:15
Kalle Hiitola, Next Games. Walking Dead No Man’s Land, the number 1 game on Apple App Store. Built on Azure.

9:14
Store petabytes of data 99.99% availability. ACID consistency.

9:13
We have just doubled the platforms that SQL Server will run on. We live on The Planet of the Apps. Global apps. The fastest database for planet-scale is DocumentDB. NoSQL database.

9:12
That is amazing!

9:11
Now time to restore the database that was backed up on a Windows box. Now run a query.

9:10
He is copying a backup file. Now connecting with SSMS.

9:09
Next, configure the database. Installed in a few seconds. Now to start up.

9:08
SQL Server on Linux. Here is a demo. Command line install process.

9:07
145 TB FastTrack with 1.2 PB of user data. 24 TB of RAM. On premises or in Azure.

9:06
Better together with Windows server. Fast Track Architecture.

9:05
Intelligent Database Service — use machine learning to find attacks

9:04
Can the optimizer be made better?

9:03
All reporting tools just work

9:02
Took about 33 seconds across 5 different data sources.

9:01
Pretty complicated join

9:00
Data living in Teradata, Oracle, SQL Server, MongoDB, Hadoop

9:00
Demo, largest number of flights to Seattle from which city?

8:58
PolyBase to connect to non-SQL data. THen can query as it if was a SQL table

8:57
Solution uses AG. Analytics run on secondaries

8:56
HTAP solution scaled out.

8:55
Improved performance 100X in discount pricing app. There is a session on Thursday talking about this.

8:54
57% of the 3 B airline tickets are priced by PROS. The airlines respond to requests within 20 ms.

8:53
Apply data science to real world business problems.

8:52
Justin Silver, Scientist PROS. How many here flew to this conference? How was the price determined? PROS helps companies like airlines figure out prices using data science and massive datasets.

8:51
Jack Henry and associates processes 1.3 M loans / sec with this software running against SQL Server 2016.

8:50
Predict loan defaults. 20 M loans, an R model, advanced reporting for credit unions product. In real time predict what happens if credit score changes, interest rate changes, etc.

8:49
1 M predictions per second

8:48
SQL Server was able to process 1 M transactions per second.

8:47
that is the load on entire Visa cc processing. SQL can handle it

8:46
3 transactions per second. Raise to 56,000 transactions per second.

8:45
R script in a stored procedure.

8:44
Demo time. Fraud detection in real time.

8:43
R is the fastest growing language in analytics. Run R on column store indexed in-memory table.

8:42
Real-time analytics on production data. GA: 11/15/2016 1st fully managed HTAP in Azure SQL DB. Hybrid analytics and processing

8:41
Rohan Kumar — Intelligence DB
We are the number 1 database!! In-memory analytics (column store) + In-memory OLTP.

8:40
30 Billion database transactions a year running on SQL Server!!

8:39
Tap technology. Has SQL Server 2016 behind it. Very fast credit card processing.

8:38
Microsoft is the leader in the Gartners magic quadrant. Playing a video

8:37
Any data with Polybase and analytics with R.

8:36
SQL Server 2016 is a comprehensive platform that runs on premises or the cloud, and Linux (next year).

8:35
Intelligence DB. Push intelligence to where data lives. Share models between applications.

8:33
3 major innovations: Intelligence DB, Intelligent Lake, and Deep Intelligence

8:32
Intelligence in every software. Get deep predictive intelligence by integrating R and machine learning.

8:31
Azure machine learning is changing lives. A.C.I.D = Algorithms Cloud IOT Data

8:30
Many children in India drop out of school. They do not get to reach their potentials. Student drop-out prediction service to prevent children from dropping out and improve education.

8:28
Joseph Sirosh, head of data platform. Data can change lives.

8:27
Meet at least 5 new people this week. Visit the Microsoft area to ask your questions.

8:26
Visit our sponsors in exhibit hall. Thanks to the sponsors!

8:25
PASS will help you achieve your potential!

8:24
She is the leader in Louisville and a regional mentor!

8:23
MALA!

8:23
Volunteers drive PASS. Sounds like it is time for the PASSion award!

8:22
PASS is the one community for all data professionals. 300 chapters, 250K members, 170 countries.

8:20
500 Microsoft engineers and specialists onsite!

8:19
Adam Jorgensen, PASS President, on stage welcoming us.

8:18
Lights down, Welcome to PASS!

8:15
Watch the keynote live at http://PASSsummit.com

8:00 am
I have arrived and have my laptop set up in the ballroom for the opening keynote. I can feel the energy in the room as #sqlfamily members say hello.

Posted in Uncategorized | Leave a comment

DevUp Session

Today I spoke at the DevUp conference in St. Louis. This conference has been rebranded from Days of .NET and continues to be a fantastic conference year after year. If you attended my session, The Top 5 Mistakes You Are Probably Making with SQL Server, you can download my slides here.

One of the cool things about this conference is the large number of sponsors looking for developers. If you want to have a career as a programmer, St. Louis is the place to be. Earlier this year, St. Louis was recognized as the top start up city in the country.

There is another thing about St. Louis that I can’t stop talking about: LaunchCode. LaunchCode is a nonprofit founded by Jim McKelvey. LaunchCode helps people get careers in technology even if they don’t have all the checkboxes, like a degree and experience, checked. They match up talent to companies needing talent in internships. Nine times out of ten, those internships lead to full time jobs. I am proud to be a LaunchCode mentor!

Posted in Uncategorized | Leave a comment