I found a pattern: if we assume database=>warehouse=>ETL=>Viz=>AI/ML is the ladder of data science pyramid, it seems that the closer to the bottom, the less variant of options are used. For example, Company D only uses SQL server for data storage while almost everything in AI/ML.So my takeaway from your sharing is that:1. it takes more efforts, time and qualifications to be a data scientist than a data engineer;2. the data engineering plays an important role in a company, because of its nature of elementalness.


Image by tableau.com

Data Visualization

Impress your audience and bosses!

To me, Tableau is the only kind of tool that allows me to do data science as an artist. However, there will be no fun if everyone does the same visualization with Tableau. This article is one episode of my series “Make Your Dashboard Stand Out” which provides you with some brilliant but not default visualization ideas. If you are new to me, do check out the following articles:

(TO BE CONTINUED)

In this post, I am going to show you an ideal option to illustrate the quantitative relationship between different entities under multiple categories — Sankey Diagram.


Image by tableau.com

Data Visualization

Impress your audience and bosses!

To me, Tableau is the only kind of tool that allows me to do data science as an artist. However, there will be no fun if everyone does the same visualization with Tableau. This article is one episode of my series “Make Your Dashboard Stand Out” which provides you with some brilliant but not default visualization ideas. If you are new to me, do check out the following articles:

(TO BE CONTINUED)

In this post, I am going to show you an ideal option to illustrate the comparison between categorical/binary data — dumbbell chart.

GIF By MightyMike

Ideas

It is pretty…


Image by Tableau.com

Data Visualization

Impress your clients and bosses!

To me, Tableau is the only kind of tool that allows me to do data science as an artist. However, there will be no fun if everyone does the same visualization with Tableau. This article is one episode of my series “Make Your Dashboard Stand Out” which provides you with some brilliant but not default visualization ideas. If you are new to me, do check out the following articles:

(TO BE CONTINUED)

In this post, I am introducing you to a lite way of displaying your statewide information: Tile Map.


Image by tableau.com

Data Visualization

Impress your clients and bosses!

To me, Tableau is the only kind of tool that allows me to do data science as an artist. However, there will be no fun if everyone does the same visualization with Tableau. This article is one episode of my series “Make Your Dashboard Stand Out” which provides you with some brilliant but not default visualization ideas. If you are new to me, do check out the following articles:

(TO BE CONTINUED)

In this post, I am going to show you an alternative to display your percentage data: a waffle chart.


Image by tableau.com

Data Visualization

Impress your audience and bosses!

To me, Tableau is the only kind of tool that allows me to do data science as an artist. However, there will be no fun if everyone does the same visualization with Tableau. This article is one episode of my series “Make Your Dashboard Stand Out” which provides you with some brilliant but not default visualization ideas. If you are new to me, do check out the following articles:

(TO BE CONTINUED)

In this post, I am going to new a way of depicting completion: fill percentage ball chart!


Image by Tableau.com

Data Visualization

Impress your clients and bosses!

To me, Tableau is the only kind of tool that allows me to do data science as an artist. However, there will be no fun if everyone does the same visualization with Tableau. This article is one episode of my series “Make Your Dashboard Stand Out” which provides you with some brilliant but not default visualization ideas. If you are new to me, do check out the following articles:

(TO BE CONTINUED)

In this post, I am going to show you an alternative to display your percentage data: dotted progress bar.


Deep Learning, Web Scraping

A way to introduce new movies to any recommendation system

Photo by Charles Deluvio on Unsplash

Disclaimer: This article is only for educational purposes. We do not encourage anyone to scrape websites, especially those web properties that may have terms and conditions against such actions.

Previously, I developed a movie recommendation system using Natural Language Processing. It can provide advice to any user of this platform whilst an established system is expected to include new movies constantly. In this article, I am going to introduce a method that helps a recommendation system include new movies in the dataset when their production companies do not provide their genre information. …


In this article, I am going to introduce how I develop an ML-based web application that can predict the odds of individual players and sides to secure a rebound on the court.

First of all, let me show what the app eventually looks like:

Go check out http://okc-thunder-rebounds.herokuapp.com/ (image by author)

As is indicated from the image above, users will be able to get the probability for each player/side to get the rebound, which is useful to basketball operators when they need to arrange tactics about rebounding. And some of the takeaways from the GIF above are:

  1. We need an interface in the frontend that allows users to place the players on the court by dragging the items;
  2. we need a kernel in the backend that can predict any individual probability for a player to grab the rebound (and…


Data Visualization

Using Easier Syntax than Plotly’s

If you follow the trending data science projects frequently enough, it’s not difficult for you to find that Plotly, which is born for interactive data visualization, is so dominative. I admit that Plotly is useful to plenty of degrees, except when you are not experienced with it and need to produce something immediately.

Photo by William Iven on Unsplash

In this article, I am going to introduce a method that is seldom used but easily mastered: creating interactive plots using the well-known matplotlib! This requires nothing but your knowledge of matplotlib.

What do we need?

To assist with matplotlib, all we need is to import the package ipywidgets. Ipywidgets is…

Memphis Meng

Grad student @ Boston University, aspiring data scientist and sports analyst. Buy me a coffee now(https://www.buymeacoffee.com/MemphisMeng)!

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store