Treasure Data

Welcome to our feedback forum. Let us know how we can improve your experience with our product.

I think Treasure Data should...

(thinking…)

Enter your idea and we'll search to see if someone has already suggested it.

If a similar idea already exists, you can support and comment on it.

If it doesn't exist, you can post your idea so others can support it.

Enter your idea and we'll search to see if someone has already suggested it.

  1. Add support for variables in Presto web

    It would be excellent if I could declare variables somehow. I don't know how this would be implemented, but I use Presto so much for repeated queries that it would be nice to be able to just change variables at the top instead of manually changing values (for instance, dates that are used many times throughout the query) by hand.

    10 votes
    Sign in
    Check!
    (thinking…)
    Reset
    or sign in with
    • facebook
    • google
      Password icon
      I agree to the terms of service
      Signed in as (Sign out)

      We’ll send you updates on this idea

    • Support multiple timestamp columns

      This should be pretty self explanatory. Currently TD supports only one timestamp column, while many tables will have more than one timestamp field. It's clumsy to have to store timestamps as strings, and then perform conversion each time the field is used.

      10 votes
      Sign in
      Check!
      (thinking…)
      Reset
      or sign in with
      • facebook
      • google
        Password icon
        I agree to the terms of service
        Signed in as (Sign out)

        We’ll send you updates on this idea

      • Feature for Timeout of too long running query

        If Hive or Presto query run for a unexpected long time, we would like to kill it automatically.
        So, it would be nice if we can set timeout as query option.

        When we set 30 min as timeout, Hive/Presto query is killed automatically if it's running over 30 mins.

        8 votes
        Sign in
        Check!
        (thinking…)
        Reset
        or sign in with
        • facebook
        • google
          Password icon
          I agree to the terms of service
          Signed in as (Sign out)

          We’ll send you updates on this idea

        • Support UDF using sql or python

          It would be nice to support like plpythonu not only SQL based UDF.
          Of course, I don't care If it wouldn't support file I/O and network access.

          e.g. https://aws.amazon.com/jp/blogs/aws/user-defined-functions-for-amazon-redshift/

          7 votes
          Sign in
          Check!
          (thinking…)
          Reset
          or sign in with
          • facebook
          • google
            Password icon
            I agree to the terms of service
            Signed in as (Sign out)

            We’ll send you updates on this idea

          • 6 votes
            Sign in
            Check!
            (thinking…)
            Reset
            or sign in with
            • facebook
            • google
              Password icon
              I agree to the terms of service
              Signed in as (Sign out)

              We’ll send you updates on this idea

            • have the same output for TD_LAT_LONG_TO_COUNTRY and TD_IP_TO_COUNTRY_NAME

              Right now, the two location UDFs report slightly different names for some countries. Ones we've found are:

              'United States of America' vs 'United States'
              'South Korea' vs 'Republic of Korea'
              'Hong Kong S.A.R.' vs 'Hong Kong'

              Ideally, there should be a single standard at least within TD for full county names.

              5 votes
              Sign in
              Check!
              (thinking…)
              Reset
              or sign in with
              • facebook
              • google
                Password icon
                I agree to the terms of service
                Signed in as (Sign out)

                We’ll send you updates on this idea

              • Support view table

                Since hive supports `with` statement, it might be easy to support view table internal emulation.
                I need view table because it would be help to write short query.

                4 votes
                Sign in
                Check!
                (thinking…)
                Reset
                or sign in with
                • facebook
                • google
                  Password icon
                  I agree to the terms of service
                  Signed in as (Sign out)

                  We’ll send you updates on this idea

                • Set the default time zone of TD time UDFs

                  In the current situation in Japan, it is necessary to add the JST to the end of the argument every time when using TD time UDFs, TD_TIME_ADD, TD_TIME_RANGE, and TD_TIME_FORMAT and so on. It is useful to be able to set the default to JST.

                  4 votes
                  Sign in
                  Check!
                  (thinking…)
                  Reset
                  or sign in with
                  • facebook
                  • google
                    Password icon
                    I agree to the terms of service
                    Signed in as (Sign out)

                    We’ll send you updates on this idea

                  • Support Clustering algorithm (e.g., k-means)

                    It would be nice to support clustering algorithm, such as k-means, as Hivemall UDFs.

                    4 votes
                    Sign in
                    Check!
                    (thinking…)
                    Reset
                    or sign in with
                    • facebook
                    • google
                      Password icon
                      I agree to the terms of service
                      Signed in as (Sign out)

                      We’ll send you updates on this idea

                    • Have a pivot function like in Oracle

                      Oracle has a pivot function which makes it easy to take values in a particular column and turn those values into columns. Here is a description of that function: http://www.techonthenet.com/oracle/pivot.php

                      It would be amazing if we could have this functionality on TD too.

                      4 votes
                      Sign in
                      Check!
                      (thinking…)
                      Reset
                      or sign in with
                      • facebook
                      • google
                        Password icon
                        I agree to the terms of service
                        Signed in as (Sign out)

                        We’ll send you updates on this idea

                      • 3 votes
                        Sign in
                        Check!
                        (thinking…)
                        Reset
                        or sign in with
                        • facebook
                        • google
                          Password icon
                          I agree to the terms of service
                          Signed in as (Sign out)

                          We’ll send you updates on this idea

                        • Query retry should skip retrying when it is from SQL syntax error

                          Let say we have table AAA without column aaa, then

                          'select aaa from AAA' get error like following.

                          Query 20150821_071516_06355_77wcr failed: Column 'aaa' cannot be resolved

                          When we issue SQL with retry 1, it immediately returns, but with retry 5 for example, we need to wait long time.

                          It is better for retry feature to understand what type of error need to handle with retry.

                          It is better syntax error returns immediately regardless of retry setting.

                          3 votes
                          Sign in
                          Check!
                          (thinking…)
                          Reset
                          or sign in with
                          • facebook
                          • google
                            Password icon
                            I agree to the terms of service
                            Signed in as (Sign out)

                            We’ll send you updates on this idea

                          • Support DELETE clause by Query

                            Currently, TreasureData can data data by time column.
                            And, it needs to use td table:partial_delete command.

                            But, we want to delete data by using Hive/Presto.
                            And then, we want to use any conditions to delete data.

                            https://docs.treasuredata.com/articles/deletion

                            3 votes
                            Sign in
                            Check!
                            (thinking…)
                            Reset
                            or sign in with
                            • facebook
                            • google
                              Password icon
                              I agree to the terms of service
                              Signed in as (Sign out)

                              We’ll send you updates on this idea

                            • Get city name from IP address

                              We can get country name from IP address using TD_IP_TO_COUNTRY_CODE function. Getting city name from IP is very useful to analyze data in detail.

                              3 votes
                              Sign in
                              Check!
                              (thinking…)
                              Reset
                              or sign in with
                              • facebook
                              • google
                                Password icon
                                I agree to the terms of service
                                Signed in as (Sign out)

                                We’ll send you updates on this idea

                              • Clear indication of inserted records of Presto query.

                                When using Presto's create/insert query, we are hard to find the number of inserted records.
                                We want to easily find it.

                                3 votes
                                Sign in
                                Check!
                                (thinking…)
                                Reset
                                or sign in with
                                • facebook
                                • google
                                  Password icon
                                  I agree to the terms of service
                                  Signed in as (Sign out)

                                  We’ll send you updates on this idea

                                • Show number of records found in the Jobs tab

                                  Hive jobs currently don't have "#records" field available

                                  2 votes
                                  Sign in
                                  Check!
                                  (thinking…)
                                  Reset
                                  or sign in with
                                  • facebook
                                  • google
                                    Password icon
                                    I agree to the terms of service
                                    Signed in as (Sign out)

                                    We’ll send you updates on this idea

                                  • Notification for zero record throughput instead of failure

                                    Get a notification when throughput is zero records rather than when there is no communication between TD and the TD-Agent server. Our Replica DB failed and I spent a while staring at our TD configuration when the problem was obviously the DB.

                                    2 votes
                                    Sign in
                                    Check!
                                    (thinking…)
                                    Reset
                                    or sign in with
                                    • facebook
                                    • google
                                      Password icon
                                      I agree to the terms of service
                                      Signed in as (Sign out)

                                      We’ll send you updates on this idea

                                    • Encryption for data at rest

                                      Customers with regulatory requirements might need certain data fields be encrypted on disk. The question is how to provide encryption with minimal impact to performance and usability of the system.

                                      2 votes
                                      Sign in
                                      Check!
                                      (thinking…)
                                      Reset
                                      or sign in with
                                      • facebook
                                      • google
                                        Password icon
                                        I agree to the terms of service
                                        Signed in as (Sign out)

                                        We’ll send you updates on this idea

                                      • 2 votes
                                        Sign in
                                        Check!
                                        (thinking…)
                                        Reset
                                        or sign in with
                                        • facebook
                                        • google
                                          Password icon
                                          I agree to the terms of service
                                          Signed in as (Sign out)

                                          We’ll send you updates on this idea

                                        • Support TD_TIME_ADD(time, '-1M') to get last month data

                                          Support TD_TIME_ADD(time, '-1M') to get last month data in Hive/Presto.

                                          Because, currently, we need to write the following.

                                          WHERE TD_TIME_RANGE(time,
                                          TD_DATE_TRUNC(
                                          'month',
                                          TD_TIME_ADD(
                                          TD_DATE_TRUNC(
                                          'month',
                                          TD_SCHEDULED_TIME(),
                                          'JST'
                                          ), -- 1st day of this month
                                          '-1d',
                                          'JST'
                                          ), -- last day of last month
                                          'JST'
                                          ), -- 1st day of last month
                                          NULL,
                                          'JST'
                                          )

                                          2 votes
                                          Sign in
                                          Check!
                                          (thinking…)
                                          Reset
                                          or sign in with
                                          • facebook
                                          • google
                                            Password icon
                                            I agree to the terms of service
                                            Signed in as (Sign out)

                                            We’ll send you updates on this idea

                                          ← Previous 1
                                          • Don't see your idea?

                                          Treasure Data

                                          Feedback and Knowledge Base