Scott Hanselman

The .NET CoreCLR is now open source, so I ran the GitHub repo through Microsoft Power BI

February 4, '15 Comments [35] Posted in Azure | Learning .NET | Open Source
Sponsored By

The hits keep on coming, Dear Reader. Just as we announced a few months back, .NET Core is open source. We said it would run on Windows, Mac, and Linux, but then the work of doing it has to actually happen. ;)

Go check out the .NET Framework Blog. Today the .NET team put the Core CLR up on GitHub. It's open source and it's under the MIT License. This includes the Core CLR source, the new RyuJIT, the .NET GC, native interop and everything you need to fork, clone, and build your own personal copy of the .NET Core CLR. What a cool day, and what an immense amount of work (both technical and legal) to make it happen. Years in the making, but still lots of work to do.

The GitHub repo has 2.6ish MILLION lines of code. They say when it's all said and done.NET Core will be about 5 MILLION lines of open source code.

The .NET Blog did a nice pie chart, but honestly, I found it to be not enough. It basically was a big grey circle that said "other 2.2M." ;)

I'd like a little more insight, but I don't know if I have the compute power, or the patience, frankly, to analyze this code repository. Or do I?

I decided to import the repository into Microsoft Power BI preview. Power BI (BI means "Business Intelligence") is an amazing service that you can use (usually for FREE, depending on your data source) to pull in huge amounts of data and ask questions of that data. Watch for a great video on this at http://friday.azure.com this week or next.

I logged into http://powerbi.com (It's US only for the preview, sorry) and clicked Get Data. I then selected GitHub as the source of my data and authorized Power BI to talk to GitHub on my behalf. Crazy, AMIRITE?

Screenshot (10)

After a few minutes of data chewing, I'm officially adding "BI and Big Data Analyst" to my resume and you can't stop me. ;)

What does Power BI tell me about the .NET Team's "CoreCLR" GitHub repository?

Here's what Power BI told me.

image

Let's dig in. Looks like Stephen Toub has worked on a LOT of this code. He's super brilliant and very nice, BTW.

image

Editing the query and looking at Dates and Times, it seems the .NET Team commits code at ALL hours. They are really feeling "committable" around 3 to 4 pm, but they'll even put code in at 4 in the morning!

image

Here's a more intense way to look at it.

image

One of the insanely cool things about Power BI is the ability to ask your data questions in plain English. Given that my SQL abilities have atrophied to "Select * from LittleBobbyTables" this is particularly useful to me.

I asked it "issues that are open sorted by date" and you'll notice that not only did it work, but it showed me what I meant underneath my query.

image

What about issues closed by a certain person?

image

I'm running around in this tool just building charts and asking questions of the repo. It's all in HTML5 but it's just like Excel. It's amazing.

image

Open issues from last year?

image

Average time to close an issue in hours?

image

It's amazing to be running queries like this on something as significant as the now open-sourced .NET Core CLR. I didn't need to be an employee to do it. I didn't need special access, I just did it. I'm enjoying this new Microsoft, and very much digging Power BI. Next I'm going to put my Blood Sugar and Diabetes Data in Power PI and encourage others to do the same.

P.S. Check out the code for the Core CLR Hello World app. When was the last time you saw an ASCII Art Linux Penguin in Microsoft Source code? ;)


Sponsor: Big thanks to Infragistics for sponsoring the feed this week! Responsive web design on any browser, any platform and any device with Infragistics jQuery/HTML5 Controls.  Get super-charged performance with the world’s fastest HTML5 Grid – Download for free now!

About Scott

Scott Hanselman is a former professor, former Chief Architect in finance, now speaker, consultant, father, diabetic, and Microsoft employee. He is a failed stand-up comic, a cornrower, and a book author.

facebook twitter subscribe
About   Newsletter
Sponsored By
Hosting By
Dedicated Windows Server Hosting by ORCS Web
Wednesday, 04 February 2015 10:40:45 UTC
I'd love to see the number of unit tests for the code base and the code coverage.

-- Lee
Wednesday, 04 February 2015 10:45:47 UTC
Hi Scott,
Thanks for being such an open source on Microsoft matters.

I noticed that some of the links in your RSS feed don't work properly.
It appears to me that the redirection doesn't support https urls and therefore we end up on feedblitz's "404 Not Found" page. It could also be solved by removing "http://feeds.hanselman.com/~/t/0/0/scotthanselman/~" from the links in the RSS feed.

(you remember RSS feeds? Those xml-ish versions of your blog's content, we raved about in the early 00s?)
Tune
Wednesday, 04 February 2015 11:51:18 UTC
Going "slightly" off topic. Is there a HTML/CSS/JS framework available public for making sides like the PowerBI site? Looks like a nice dashboard/admin theme..
Christian W
Wednesday, 04 February 2015 12:19:19 UTC
Excellent ! I had no idea it was possible to grab data from a GitHub account like this.

Too bad it's US only for now. I'll definitively try PowerBI (desktop version) on an Azure SQL database to see what I can find out :-)
Wednesday, 04 February 2015 12:42:56 UTC
WOW!!! Sharing. :)
MichaelD!
Wednesday, 04 February 2015 13:26:35 UTC
Thanks for the primer of Power BI. Looks worth looking into.

More importantly: Love the XKCD reference!
Peter Jølving
Wednesday, 04 February 2015 13:56:51 UTC
Wow!!
I would love to run my customer's data through Power BI! I am most definitely going to check it out when it becomes available to the rest of us.
James
Wednesday, 04 February 2015 14:04:33 UTC
You have a way with expression my friend, such a gift. Thanks for sharing... AGAIN!
Aaron
Wednesday, 04 February 2015 14:08:28 UTC
Looks great, but can't sign up :(

I keep getting the message "Sorry, that didn't work. There's a problem on our end. We're working on it, so try again later."

Is this still in alpha or beta?
Eric W
Wednesday, 04 February 2015 15:10:51 UTC
With great power comes great responsibility. Personally scared by the idea that I could change the CLR...

"Got a bug?"
"Let me just recompile the CLR.... there you go"
Taki
Wednesday, 04 February 2015 15:25:37 UTC
Very cool demo, but: Deprecating DateTime.Now scares me.
John Dunagan
Wednesday, 04 February 2015 17:25:27 UTC
I really liked this post. I had worked for many years in the CoreCLR team and can clearly see how the team can use this insight :). And Kudos to my previous team as well !!
Wednesday, 04 February 2015 17:32:03 UTC
@Eric, sorry you hit problems signing up for Power BI. Send me an email at support@powerbi.uservoice.com and we'll help debug your issue.
Adam Wilson
Wednesday, 04 February 2015 18:15:26 UTC
I could literally cry right now. I just spent 9 hours last night compiling stats on the DNN repo by hand after hitting a wall on a couple of different automation attempts. Well, I guess I can look forward to a much easier effort for my next DNN release.
Wednesday, 04 February 2015 18:45:38 UTC
Awesome Scott. But since you are great at (and excited about) reports and you can't do SQL anymore, it looks like it's time for you to get into management... ;)
PRMan
Wednesday, 04 February 2015 23:54:36 UTC
Looked very cool and decided to give it a try. Sadly, after getting through the GitHub auth, loading the data failed on two separate attempts, with the same not-really-helpful error info (included below).

oops, something went wrong
Failed to store data for new tile
Activity Id 138424df-21eb-4185-9e26-73b195f2ba09
Request Id 687eec49-4af4-3664-abcf-e2edbffcec32
Error Code 400
Time Wed Feb 04 2015 18:50:26 GMT-0500 (EST)
Version 11.0.9165.681
Cluster URI https://wabi-us-east2-redirect.analysis.windows.net
Ryan LaNeve
Thursday, 05 February 2015 05:20:40 UTC
@Ryan, Sorry you are having issues importing from GitHub. We would love to get to the bottom of this, please send us an email at support@powerbi.uservoice.com so we can figure out what is going on.

Thursday, 05 February 2015 06:58:48 UTC
Even I didn't like their pie chart; thanks for drilling into to the 'other' section, because I was curious as well.

PowerBI is much more powerful than what you demoed here I presume, but thanks for the demo!
Sachin Joseph
Thursday, 05 February 2015 10:43:05 UTC
It's so cool that I can now run a Hello World console application and debug the CLR!
Thursday, 05 February 2015 16:50:07 UTC
We've never had such an open view into the internals of .NET, so thank you Microsoft for finally going open-source, and thank you Scott for doing all these charts so we can understand it better.
Thursday, 05 February 2015 18:59:42 UTC
They got ASCII Linux and Apple logos but no Windows one? #fail
Thursday, 05 February 2015 20:12:17 UTC
Vesselin - Look again. ;) They programmatically create the Windows logo.
Scott Hanselman
Thursday, 05 February 2015 21:37:45 UTC
Love to see visual studio in linux and mac, little greedy is not it. cool job Scott as usual.
Gomes
Friday, 06 February 2015 09:05:42 UTC
how much are Microsoft paying you to do free endorsement of POWER BI and praise for them ... ho you are a Microsoft employee ... so nothing...
asdasd
Friday, 06 February 2015 10:07:51 UTC
ASDASD - (Nice username ;) I only talk about what is awesome on my blog. It's my blog and not my employer's. I've got well over a decade of blog posts to prove it. Power BI is insanely cool.
Scott Hanselman
Friday, 06 February 2015 12:05:54 UTC
I think an important point that warrants further investigation is: Who or what is FiveTimesTheFun? That's a lot of fun!!!
And Power BI looks dope :)
Brandan
Friday, 06 February 2015 14:52:26 UTC
it would be a nice idea to mix PowerBI with Bitergia (http://bitergia.com) tools ;)
Sunday, 08 February 2015 09:13:07 UTC
Looks great, but unfortunately there is no way my organisation would allow their data anywhere near a cloud based service. Is this toolset going to be available to use on-premise?
Rich Linnell
Monday, 09 February 2015 03:10:30 UTC
Hi Scott, you probably have very little to do with it, but you may know people who know people who has to do with it - anyway, https://powerbi.com serves wrong cert, specifically a *.azurewebsites.net cert. So Chrome didn't want to let me in.
Screenshot: http://cl.ly/image/2j2k1D133x36/Image%202015-02-08%20at%207.09.22%20PM.png
George
Monday, 09 February 2015 03:12:38 UTC
Also, Power BI seems to be working fine from Canada as well.
George
Monday, 09 February 2015 10:05:23 UTC
Importing, analysing and reporting on huge amounts of data is cool I suppose, but to make it awesome it needs a button that automagically exports selected data, screenshots and charts to Sway! ;)
Col
Monday, 09 February 2015 22:59:01 UTC
Wow changing the microsoft logo paid off well now it can be displayed in Linux. Could you do a another article on Power BI how to integrate this with TFS data
Ravi
Wednesday, 18 February 2015 11:43:51 UTC
Nice work Scott! Really like the integration of Power BI with github. By the way, conspiracy theories are like fashion these days. Don't try to respond to these, let them express their minds. You're way above that my friend. Thank you for what you do(you're one of the best at it!)
asissokho
Tuesday, 17 March 2015 08:56:03 UTC
PVS-Studio: 25 Suspicious Code Fragments in CoreCLR. http://www.viva64.com/en/b/0310/
Saturday, 18 April 2015 09:42:32 UTC
great job scott . Well said .
and Love to see visual studio in linux and mac..
Comments are closed.

Disclaimer: The opinions expressed herein are my own personal opinions and do not represent my employer's view in any way.