Getting started with data modeling

The data model is used to transform raw data into meaningful business definitions and pre-aggregate data for optimal results. The data model is exposed through a rich set of APIs that allows end-users to run a wide variety of analytical queries without modifying the data model itself.

Let’s use a users table with the following columns as an example:

We can start with a set of simple questions about users we want to answer:

• How many users do we have?
• How many paying users?
• What is the percentage of paying users out of the total?
• How many users, paying or not, are from different cities and companies?

We don’t need to write SQL queries for every question, since the data model allows building well-organized and reusable SQL.

1. Creating a Cube

In Cube, cubes are used to organize entities and connections between entities. Usually one cube is created for each table in the database, such as users, orders, products, etc. In the sql_table parameter of the cube we define a base table for this cube. In our case, the base table is simply our users table.

cubes:
  - name: users
    sql_table: users

2. Adding Measures and Dimensions

Once the base table is defined, the next step is to add measures and dimensions to the cube.

Let's go ahead and create our first measure and two dimensions:

cubes:
  - name: users
    sql_table: users
 
    measures:
      - name: count
        sql: id
        type: count
 
    dimensions:
      - name: city
        sql: city
        type: string
 
      - name: company_name
        sql: company_name
        type: string

Let's break down the above code snippet piece-by-piece. After defining the base table for the cube (with the sql_table property), we create a count measure in the measures block. The count type and sql id means that when this measure will be requested via an API, Cube will generate and execute the following SQL:

SELECT COUNT(id) AS count
FROM users;

When we apply a city dimension to the measure to see "Where are users based?", Cube will generate SQL with a GROUP BY clause:

SELECT city, COUNT(id) AS count
FROM users
GROUP BY 1;

You can add as many dimensions as you want to your query when you perform grouping.

3. Adding Filters to Measures

Now let's answer the next question – "How many paying users do we have?". To accomplish this, we will introduce measure filters:

cubes:
  - name: users
 
    measures:
      - name: count
        sql: id
        type: count
 
      - name: paying_count
        sql: id
        type: count
        filters:
          - sql: "{CUBE}.paying = 'true'"
 
    # ...

That's it! Now we have the paying_count measure, which shows only our paying users. When this measure is requested, Cube will generate the following SQL:

SELECT
  COUNT(
    CASE WHEN (users.paying = 'true') THEN users.id END
  ) AS paying_count
FROM users

Since the filters property is an array, you can apply as many filters as required. paying_count can be used with dimensions the same way as a simple count. We can group paying_count by city and companyName simply by adding these dimensions alongside measures in the requested query.

4. Using Calculated Measures

To answer "What is the percentage of paying users out of the total?", we need to calculate the paying users ratio, which is basically paying_count / count. Cube makes it extremely easy to perform this kind of calculation by defining a calculated measure. Let's add a new measure to our cube called paying_percentage:

cubes:
  - name: users
 
    measures:
      - name: count
        sql: id
        type: count
 
      - name: paying_count
        sql: id
        type: count
        filters:
          - sql: "{CUBE}.paying = 'true'"
 
      - name: paying_percentage
        sql: "100.0 * {paying_count} / {count}"
        type: number
        format: percent
 
    # ...

Here we defined a calculated measure paying_percentage, which divides paying_count by count. This example shows how you can reference measures inside other measure definitions. When you request the paying_percentage measure via an API, the following SQL will be generated:

SELECT
  100.0 * COUNT(
    CASE WHEN (users.paying = 'true') THEN users.id END
  ) / COUNT(users.id) AS paying_percentage
FROM users

As with other measures, paying_percentage can be used with dimensions.

5. Next Steps

1. Query format
2. REST API
3. Data model reference documentation