Treasure Data

Welcome to our feedback forum. Let us know how we can improve your experience with our product.

I think Treasure Data should...

(thinking…)

Enter your idea and we'll search to see if someone has already suggested it.

If a similar idea already exists, you can support and comment on it.

If it doesn't exist, you can post your idea so others can support it.

Enter your idea and we'll search to see if someone has already suggested it.

  1. Support parameterization of the filename and path for Result Export to S3

    Hive and Presto jobs can export data to AWS S3 but the destination prefix for the file is hardcoded in the result export configuration.
    Some users want to programmatically export data from TD to S3 in 'chunks' and would like the ability to setup a scheduled job that export to a destination file in S3 whose name is defined by a variable, such as the job ID, the execution date/time, or other unique identifier.

    20 votes
    Sign in
    Check!
    (thinking…)
    Reset
    or sign in with
    • facebook
    • google
      Password icon
      I agree to the terms of service
      Signed in as (Sign out)

      We’ll send you updates on this idea

      0 comments  ·  Outputs  ·  Admin →
    • Retry only Result Export without rerunning Hive and Presto query

      When we start to test Result Export to any targets in the beginning, we often failed to output data to the target because of misconfiguration.

      In this case, we need to retry the queries again and again.
      It needs a lot of time.

      Therefore, it is useful if we could retry only Result Export part without hive and presto query after changing Result Export configuration.

      12 votes
      Sign in
      Check!
      (thinking…)
      Reset
      or sign in with
      • facebook
      • google
        Password icon
        I agree to the terms of service
        Signed in as (Sign out)

        We’ll send you updates on this idea

        1 comment  ·  Outputs  ·  Admin →
      • Result output to Bigquery support parameterization for tablename

        TreasureData's result output doesn't have parameterization for path and file name and table name.
        But, a lot of data store needs it, because the output always replace the file.
        In Result output to BigQuery, it also needs this type of parameterization.
        Because, BigQuery require table partitioning by date to reduce query scanning.

        We want Result Output to Bigquery to set parameter tablename_%Y%m%d. Ex. log_20160618

        6 votes
        Sign in
        Check!
        (thinking…)
        Reset
        or sign in with
        • facebook
        • google
          Password icon
          I agree to the terms of service
          Signed in as (Sign out)

          We’ll send you updates on this idea

          1 comment  ·  Outputs  ·  Admin →
        • Allow easy data export of columns with time property

          Time data in TD is output in string format unless a complex process is followed to change the output into time format.

          External softwares like Tableau require output in time format in order to process the required column as a time.

          5 votes
          Sign in
          Check!
          (thinking…)
          Reset
          or sign in with
          • facebook
          • google
            Password icon
            I agree to the terms of service
            Signed in as (Sign out)

            We’ll send you updates on this idea

            0 comments  ·  Outputs  ·  Admin →

            From the historical reason (Hive didn’t support timestamp type) TD doesn’t have timestamp type, but now all query engines have. We have a plan to support timestamp type not only for time column, but more in generic way including data connectors / result outputs. We’ll update you once we have clear timeline.

          • Support Result Output to Redis

            Hivemall is useful to create ML model, but it's hard to use it for real time prediction.
            In this case, we use RDB like PostgreSQL or KVS like Redis for it.
            If Treasure Data support Result output to Redis, it would be helpful for Machine Learning User.

            3 votes
            Sign in
            Check!
            (thinking…)
            Reset
            or sign in with
            • facebook
            • google
              Password icon
              I agree to the terms of service
              Signed in as (Sign out)

              We’ll send you updates on this idea

              0 comments  ·  Outputs  ·  Admin →
            • 3 votes
              Sign in
              Check!
              (thinking…)
              Reset
              or sign in with
              • facebook
              • google
                Password icon
                I agree to the terms of service
                Signed in as (Sign out)

                We’ll send you updates on this idea

                0 comments  ·  Outputs  ·  Admin →
              • Support Result Export for FTPS

                Support Result Export for FTPS

                2 votes
                Sign in
                Check!
                (thinking…)
                Reset
                or sign in with
                • facebook
                • google
                  Password icon
                  I agree to the terms of service
                  Signed in as (Sign out)

                  We’ll send you updates on this idea

                  0 comments  ·  Outputs  ·  Admin →
                • 2 votes
                  Sign in
                  Check!
                  (thinking…)
                  Reset
                  or sign in with
                  • facebook
                  • google
                    Password icon
                    I agree to the terms of service
                    Signed in as (Sign out)

                    We’ll send you updates on this idea

                    1 comment  ·  Outputs  ·  Admin →
                  • Support TSV format on Result Output to FTP

                    Currently, Result Output to FTP support only CSV format.

                    1 vote
                    Sign in
                    Check!
                    (thinking…)
                    Reset
                    or sign in with
                    • facebook
                    • google
                      Password icon
                      I agree to the terms of service
                      Signed in as (Sign out)

                      We’ll send you updates on this idea

                      1 comment  ·  Outputs  ·  Admin →
                    • Boost result output speed to TreasureData

                      My monthly import task takes a lot of time to finish.
                      To speed up result output to TreasureData, It needs parallelize upload session part data.

                      speed to Bulk import data with
                      output result to bulk import run with single upload

                      1 vote
                      Sign in
                      Check!
                      (thinking…)
                      Reset
                      or sign in with
                      • facebook
                      • google
                        Password icon
                        I agree to the terms of service
                        Signed in as (Sign out)

                        We’ll send you updates on this idea

                        0 comments  ·  Outputs  ·  Admin →
                      • Support for header option on FTP Result Export

                        I would like you to add an header option(need header or not) on FTP Result Export.

                        1 vote
                        Sign in
                        Check!
                        (thinking…)
                        Reset
                        or sign in with
                        • facebook
                        • google
                          Password icon
                          I agree to the terms of service
                          Signed in as (Sign out)

                          We’ll send you updates on this idea

                          0 comments  ·  Outputs  ·  Admin →
                        • Support connector for Apache Zeppelin

                          Support plugin for Apache Zeppelin like pandas-td and re:dash plugin.
                          https://zeppelin.incubator.apache.org/

                          1 vote
                          Sign in
                          Check!
                          (thinking…)
                          Reset
                          or sign in with
                          • facebook
                          • google
                            Password icon
                            I agree to the terms of service
                            Signed in as (Sign out)

                            We’ll send you updates on this idea

                            0 comments  ·  Outputs  ·  Admin →
                          • Export Valid JSON

                            I tried exporting JSON and just got back:
                            [field, field2, field3, field4]
                            [field, field2, field3, field4]
                            ...

                            Instead of something useful like:
                            {field: value, field2: value, field3: value}
                            {field: value, field2: value, field3: value}

                            Why would it export invalid line by line JSON? From the looks of it, it's basically CSV but with a [ prepended and a ] appended on each line and then a missing column header row. So it's impossible to really tell to which fields the values belong.

                            For now I've cracked open Google Refine and converted the CSV export to actual line by line JSON…

                            1 vote
                            Sign in
                            Check!
                            (thinking…)
                            Reset
                            or sign in with
                            • facebook
                            • google
                              Password icon
                              I agree to the terms of service
                              Signed in as (Sign out)

                              We’ll send you updates on this idea

                              3 comments  ·  Outputs  ·  Admin →
                            • Don't see your idea?

                            Treasure Data

                            Feedback and Knowledge Base