{"id":2470,"date":"2019-10-15T11:42:08","date_gmt":"2019-10-15T06:12:08","guid":{"rendered":"http:\/\/blog.tenthplanet.in\/?p=2470"},"modified":"2026-07-06T10:56:26","modified_gmt":"2026-07-06T05:26:26","slug":"data-services-in-pentaho-regular","status":"publish","type":"post","link":"https:\/\/tenthplanet.in\/blogs\/data-services-in-pentaho-regular\/","title":{"rendered":"Pentaho+ Data Services Made Easy"},"content":{"rendered":"

Data Services in Pentaho+<\/h3>\n

1. INTRODUCTION<\/b><\/span><\/p>\n

Data Service refers to a service provider that enables data access on-demand to users regardless of their geographic location. The information is stored in the Server\/Cloud and is accessible by a wide range of systems and devices. Data services can eliminate redundancy and streamline costs by housing critical data in one location, enabling the data to be accessed and\/or updated by multiple users while ensuring a single point for updates. Data services in IT is a term for third-party services that help to manage data for clients. Many uses of this term involve services that are also called \u201cdata as a service\u201d (DaaS) \u2013 these are Web-delivered services offered by cloud vendors that perform various functions on data.<\/span><\/p>\n

2. HOW DO DATA SERVICES WORK?<\/b><\/span><\/span><\/h2>\n

\"\"
\nWhen combined with data virtualization, data services provide an abstraction layer from the details of stored data. Data virtualization provides the storage platform while data services do the programmatic work of retrieving data from the platform. Data services automate the work of locating heterogeneously-stored data and provide developers and data analysts with simple programmatic tools to find and extract the data they need with little effort. In an application, data services act as middleware, independently finding and delivering data to the application requests. Data services are essentially web services for data.<\/span><\/p>\n

3. WHAT ARE THE BENEFITS OF DATA SERVICES?<\/b><\/span><\/span><\/h2>\n

By making it easy to find and deliver data from anywhere, we can choose storage that is cost-effective and convenient to maintain. Once created, data services are reusable, making it possible for the organization to save a great deal of time on future development. <\/span><\/p>\n

4. Pentaho+ – DATA SERVICE IMPLEMENTATION<\/b><\/span><\/p>\n

A <\/span>Pentaho+ Data Service <\/span><\/b>is a virtual table that contains the output of a PDI transformation. You can connect to and query a regular <\/span>Pentaho+ Data Service <\/span><\/b>from any <\/span>Pentaho+ <\/span><\/b>tool, such as Report Designer, the PDI client (Spoon), Analyzer <\/span>and CTools as well as other compatible tools like RStudio, DBVisualizer, or SquirreL.<\/span><\/span><\/p>\n

    \n
  • We<\/span> must have a Pentaho+ Server and repository to publish the data service.<\/span><\/span><\/li>\n<\/ul>\n

    4.1 Creating a Regular Pentaho+ Data Service<\/b><\/span><\/span><\/p>\n

      \n
    • We can create Pentaho+ Data Service to any step in a transformation. <\/span><\/span><\/li>\n<\/ul>\n

      \"\"<\/p>\n

      The above transformation shows that the Data Service is created to the Output of the Final Output.<\/span><\/p>\n

        \n
      • \n

        To create a Pentaho+ Data Service to any Step imply the following,<\/span><\/p>\n<\/li>\n<\/ul>\n

        \"\"\"\"<\/p>\n

        Right click on the Step, then click on the \u201cData Services\u201d, Click \u201cNew..\u201d <\/span><\/p>\n

        Then the following window will appear.<\/span><\/p>\n

        \"\"<\/p>\n

          \n
        • \n

          Service Name<\/b>: Give a Unique Data Service Name. No other data service name should be the same as published to Pentaho+ Server.<\/span><\/span><\/p>\n<\/li>\n

        • \n

          Output Step:<\/b> Select the Step for which the Data Service should provide.<\/span><\/span><\/p>\n<\/li>\n

        • \n

          Data Service Type<\/b><\/span><\/span>: Select \u201cRegular\u201d or \u201cStreaming\u201d. <\/span><\/span>A streaming data service is commonly used when <\/span><\/span>creating a streaming data dashboard with CTools<\/span><\/span> .<\/span><\/span><\/p>\n<\/li>\n

        • \n

          Service Cache<\/b>: Adjusts how long data results are cached. Consider using this technique if either of the following applies. Your result set contains modest data sizes or You query Big Data sources. Increasing the cache duration can help subsequent follow-on queries run more quickly.<\/span><\/span><\/p>\n<\/li>\n

        • \n

          Query Pushdown<\/b><\/span><\/span>: <\/span><\/span>Consider using this technique if both of the following apply. <\/span><\/span>Your transformation contains the <\/span><\/span>Table Input <\/span><\/span><\/strong>or <\/span><\/span>MongoDB Input <\/span><\/span><\/strong>steps. You are using simple or complex WHERE clauses that include AND, IN, or other specific operators in your query. Limits for the WHERE<\/span><\/span> clause construction appear in <\/span><\/span>Pentaho+ Data Service SQL Support Reference and Other Development Considerations<\/span><\/span>.<\/span><\/span><\/p>\n<\/li>\n

        • \n

          P<\/b><\/span><\/span>arameter Pushdown<\/b><\/span><\/span>: <\/span><\/span>Your transformation contains any step that should be optimized, including input steps like <\/span><\/span>REST<\/span><\/span><\/strong> <\/b>where a parameter in the URL could limit the results returned by a web service. You do not use more complex WHERE clauses in your query that might contain IN or OR keywords.<\/span><\/span><\/p>\n<\/li>\n

        • \n

          Driver Details<\/b>: While Connecting the Data Service to the Non-Pentaho+ Tool. Download this driver and install within the tool.<\/span><\/span><\/p>\n<\/li>\n<\/ul>\n

          Click \u201cOK\u201d, Data Service will be created.<\/span><\/span><\/p>\n

          4.2 Test a Data Service<\/b><\/span><\/p>\n

            \n
          • \n

            Follow the below steps to open the test window<\/span><\/p>\n<\/li>\n<\/ul>\n

            \"\"\"\"<\/p>\n

            Click on the Test… The below window will open…<\/span><\/p>\n

            \"\"<\/p>\n

            Execute SQL to run the query, Apply Filter and test the results. \u201cData Seurity_Virtualization\u201d is the name of the Data Service created.<\/span><\/p>\n

            Max Rows: Select 100, 500, 1000. The Number of rows to be viewed.<\/span><\/p>\n

            4.3 Publish Data Service to the Pentaho+ Server<\/b><\/span><\/p>\n

              \n
            • \n

              Connect the PDI to the Pentaho+ Repository or Pentaho+ Server.<\/span><\/p>\n<\/li>\n

            • \n

              Save the Transformation that containing the Data Service into the Pentaho+ Server.<\/span><\/p>\n<\/li>\n

            • \n

              Saved .ktr files were found in the server as follows<\/span><\/p>\n<\/li>\n<\/ul>\n

              \"\"<\/p>\n

                \n
              • \n

                Create a Pentaho+ Data Service Connection in the PDI as follows<\/span><\/p>\n<\/li>\n<\/ul>\n

                \"\"<\/p>\n

                  \n
                • \n

                  Connection Name: Give a name for the connection<\/span><\/p>\n<\/li>\n

                • \n

                  Connection Type: Pentaho+ Data Services<\/span><\/p>\n<\/li>\n

                • \n

                  Access: Native (JDBC)<\/span><\/p>\n<\/li>\n

                • \n

                  Settings: Host Name \u2013 IP Address of the Pentaho+ Server<\/span><\/p>\n<\/li>\n<\/ul>\n

                  Port Number \u2013 8080 default or check with Admin<\/span><\/p>\n

                  Web App Name \u2013 Pentaho+ or Pentaho+-DI<\/span><\/p>\n

                  User Name: check with Admin<\/span><\/p>\n

                  Password: check with Admin<\/span><\/p>\n

                    \n
                  • \n

                    Test the PDI connection in the Pentaho+ Server as follows<\/span><\/p>\n

                      \n
                    • \n

                      Click \u201cManage Data Sources\u201d and click on the PDI Connection Created, then click the Edit Button and click Test.<\/span><\/p>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n

                      \"\"<\/p>\n

                        \n
                      • \n

                        Connection to Data Base Succeeded.<\/span><\/p>\n<\/li>\n<\/ul>\n

                        4.4 Access the Data Service in the Pentaho+ Tool<\/b><\/span><\/p>\n

                          \n
                        • \n

                          Drag a Table Input and provide the Pentaho+ Data Service Connection created<\/span><\/p>\n<\/li>\n<\/ul>\n

                          \"\"<\/p>\n

                            \n
                          • \n

                            Click \u201cGet SQL Select Statement\u201d and access the required Data Service created.<\/span><\/p>\n<\/li>\n

                          • \n

                            Preview the Data. Apply Filter Condition and test the results.<\/span><\/p>\n<\/li>\n<\/ul>\n

                            5. Disadvantages of Data Service:<\/b><\/span><\/p>\n

                            For instance, companies worry about what happens if the provider’s service goes down and the speed of the server.<\/span><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

                            Implementing Data Services in Pentaho (Regular)<\/p>\n","protected":false},"author":23,"featured_media":2505,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[424],"tags":[445,499,503,565,425],"class_list":["post-2470","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-pentaho","tag-etl","tag-pentaho","tag-pentaho-data-integration","tag-pentaho-data-service","tag-pentaho-etl"],"acf":[],"_links":{"self":[{"href":"https:\/\/tenthplanet.in\/blogs\/wp-json\/wp\/v2\/posts\/2470","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/tenthplanet.in\/blogs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/tenthplanet.in\/blogs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/tenthplanet.in\/blogs\/wp-json\/wp\/v2\/users\/23"}],"replies":[{"embeddable":true,"href":"https:\/\/tenthplanet.in\/blogs\/wp-json\/wp\/v2\/comments?post=2470"}],"version-history":[{"count":3,"href":"https:\/\/tenthplanet.in\/blogs\/wp-json\/wp\/v2\/posts\/2470\/revisions"}],"predecessor-version":[{"id":11661,"href":"https:\/\/tenthplanet.in\/blogs\/wp-json\/wp\/v2\/posts\/2470\/revisions\/11661"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/tenthplanet.in\/blogs\/wp-json\/wp\/v2\/media\/2505"}],"wp:attachment":[{"href":"https:\/\/tenthplanet.in\/blogs\/wp-json\/wp\/v2\/media?parent=2470"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/tenthplanet.in\/blogs\/wp-json\/wp\/v2\/categories?post=2470"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/tenthplanet.in\/blogs\/wp-json\/wp\/v2\/tags?post=2470"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}