ARTICLE :
 

Pentaho BI CTOOLS (CDF, CDA, CDE, Saiku Analytics etc) using Cygwin

by Yogaraj Khanal on October 1st, 2011

Introduction

This article demonstrates the integration and installation of Pentaho BI CTOOLS like CDF,CDA,CDE,Saiku Analytics etc using installer using Cygwin(UNIX) environment for Windows.

Background

Pentaho is the open source business intelligence development platform which has different components integrated with it. You have both open source and commercial version available to support your BI need. This article is scoped to help open source business intelligence developer to integrate CTOOLS on CDF to fulfill their dashboard development BI needs.

Detail

This article is my continued exploration on Pentaho Business Intelligence (BI) CDF tools.Please review my article posted here for the background information.

http://codeissue.com/articles/a04e30b116be00f/integration-of-pentaho-bi-community-dashboard-editor-cde-with-community
In this article I have explained the long process on how to get CDE up and running with CDF. But when I accidently stepped in this blog I thought I will give it a try.

http://pedroalves-bi.blogspot.com/2011/06/ctools-installer-making-things-fast.html
So as per this blog it said I can automate my manual steps that I did in first article with the script and was able to do it without any problems in Unix but faced some difficulties in Windows environment. So just wanted to share my finding and steps with you so that it might be useful in your research and development like myself.

So if you follow the steps in my first article then you see pentaho up and running like this.


Figure I: Default Pentaho BI CDF that you will get after download

Please ignore the remaining steps on integrating CDEon CDF .In this article I will demonstrate how you can use installer to integrate all the CTOOLS like CDE CDA CDF and Saiku Analytics with dashboard samples as one task.So let’s get started.
First step is to download Cygwin an UNIX environment for Windows.You can download and learn more about this tool from link below and it has good manual too which is hard to find with the most open source software.
http://www.cygwin.com/

The thing I was overlooking in Pedro blog was that to get two additional package viz. wget from Web package and unzip from Archive package which are not installed by default. Please review the screen shot below for more information which will be better than my explanation in whole paragraph.


Fig II: Shows how you can select wget utility from Web Package in Cygwin


Fig III: Shows how you can select unzip utility from Archive Package in Cygwin

After this steps you Cygwin in ready to install CTOOLS for Pentaho BI.You can lunch the script as shows below:

Fig IV: Shows how you can run script from Cygwin command line like SSH in UNIX

I am just duplicating the steps to show you what kind of error you can get. If you can read the screen then you will see that it’s asking from pentaho solutions directory as next parameter. See the next screen shot closely.


Fig V: Shows how you can run script correctly

The script will download the files using wget and unzip it using unzip commands with the packages that we added in Cygwin.This process will be automated in UNIX and Linux environement and you don’t need to do this steps for Cygwin.

Next it will if its ok to delete some directories.If you have any data back it up if its new project then you can just reply yes to all. Thes it shows done as follow in the screen shot.


Fig VI: Intermediate steps in the installer steps and finally done step.

This is the screen shot that shows new Pentaho BI with added new features.Enjoy your exploration and tuned into codeissue.com for my next posts on how to connect to database and create a sample dashboard.


Fig VII: Pentaho BI in its new glory with CTOOLS

Conclusion

This article demonstrates how you can integrate Pentaho BI CTOOLS with Pentaho CDF.Keep checking codeissue.com for my next article where I will demonstrate you how to configure DataSource and creation of demo dashboard. Please free to send me your comments, suggestions and questions through this website.

References

http://pedroalves-bi.blogspot.com/2011/06/ctools-installer-making-things-fast.html
http://www.cygwin.com/
http://wiki.pentaho.com/display/COM/Community+Wiki+Home

Author:

Profile Photo
Yogaraj Khanal
Date: October 1st, 2011

Comments:



Profile Photo
Commented by Saurabh Sethi
on October 4th, 2011 at 00:27:04 EST
Hi Dear,
Thanks For Article.

Saurabh Sethi.
Email Id:- saurabhsethi@klgsystel.com


Profile Photo
Commented by Yogaraj Khanal
on November 14th, 2011 at 10:49:11 EST
# ./ctools-installer.sh -s /cygdrive/c/Users//khanaly/Pentaho310/biserver-ce/pe
ntaho-solutions/ -w /cygdrive/c/Users/khanaly//Pentaho/biserver-ce/tomcat/webap
ps//pentaho

Profile Photo
Commented by Yogaraj Khanal
on November 14th, 2011 at 10:52:49 EST
# ./ctools-installer.sh -s /cygdrive/c/Users//khanaly/Pentaho310/biserver-ce/pe
ntaho-solutions/ -w /cygdrive/c/Users/khanaly//Pentaho/biserver-ce/tomcat/webap
ps//pentaho
Just use this syntax for the latest version of CTOOLS installer

Profile Photo
Commented by Mondrian
on November 30th, 2011 at 08:58:35 EST
Hello I installed all on pentaho 3.10 stable.
I'm a newbie on pentaho and however I see CDE and SAIKU so now I'm trying to understand what CDF is it?
I tried to understand what is it by wiki and I arrived at this url: http://store.kagi.com/cgi-bin/store.cgi?storeID=6FHAR_LIVE&;currency=EUR&orderID=2a246db2f9a4b402b04ec41175e139f566305d20&lang=us&view=products&page=First%20Sales%20Page&output=html so I'm asking is it an open source project and corde or not? Did I install it by this script or not? I see only the two links CDE and SAIKU is it normal? Where is CDF and what does it allow to do?

Profile Photo
Commented by Yogaraj Khanal
on December 5th, 2011 at 09:53:17 EST
To understand CDF visit the link.According to my understanding CDF is the engine that helps you develop dashboard and working in combination with other CTOOLS here:
http://ctools.webdetails.org/
http://cdf.webdetails.org/
All projects that you can download from here community edition are free
http://wiki.pentaho.com/display/COM/Latest+Stable+Builds
Try visiting this forum for details
http://forums.pentaho.com/forumdisplay.php?80-Community-Tools-CTools
The link you are talking about is tutorial developed by webdetails creator of CTOOLS.
I think you can buy those for $50 to understand the concepts but if you follow my articles and sample they have with distribution basically they describe the same.
Actually webdetails support the paid consulting to these open source product and develop and integrates the CTOOLS with Pentaho BI.I am not part of them but individual consultant so please let me know if I can answer your question.I am also doing research and development like you regarding how I can use their product to solve business need.

Profile Photo
Commented by Mondrian
on December 11th, 2011 at 15:14:08 EST
Thanks Yogarai.
Iâm a student and I'm studying DWH and looking for a good open source tool that allows to design star schema. Iâll use Pentaho BI so let me know if there is some tool about that allows to me star schema design or something that could help me on BI design. While studying I read about the DFM methology, so I was asking if is better design a DFM model before, and after translate it in a Star Schema? How do you usually proceed? I was looking for something that is Open Source.
Thanks and Merry Christmass

Profile Photo
Commented by Yogaraj Khanal
on December 12th, 2011 at 04:10:37 EST
These are some of the open source tools that I use:
Pentaho Schema Workbench (essentially an XML editor)

http://mondrian.pentaho.com/documentation/workbench.php
http://sourceforge.net/projects/mondrian/files/schema%20workbench/

There's the AgileBI plugin for Kettle
http://wiki.pentaho.com/display/AGILEBI/Agile+BI+Kettle+4.0+Plugin+-+stable

You may have some luck with Power Architect too
http://www.sqlpower.ca/page/resources

Please use this link to find the latest stable version of Schema Workbench,Mondrian and Aggregation Designer
http://wiki.pentaho.com/display/COM/Latest+Stable+Builds
For the design approach I follow
Kimball or Inmon approach based on Requirements and Realities
http://www.nagesh.com/publications/technology/173-inmon-vs-kimball-an-analysis.html
Are you using all CTOOLS like CDE CDA CDF CST Saiku etc they are user friendly and powerful.

Profile Photo
Commented by Edwin Allen
on January 4th, 2012 at 16:54:35 EST
Yogaraj Khanal all your articles are great, thanks for all. I have a little question I installed the CTOOLS, on 3.9 version. But Im not abble to see the Saiku link just a little CDE icon, is there a special issue for using Saiku on 3.9 version.

Thanks in advance.

Profile Photo
Commented by Yogaraj Khanal
on January 6th, 2012 at 23:01:25 EST
Edwin,
Thanks for your feedback. I will write more as time permits.
Regarding CTOOLS installer should work out of the box for all plugins including Saiku.
Please try one more time by getting latest stable distribution from this link and let me know if that helps.
BI server stable latest is 3.10
http://sourceforge.net/projects/pentaho/files/Business%20Intelligence%20Server/
Also CTOOLS installer should be found here
https://github.com/pmalves/ctools-installer
please use syntax as above and use option -y to install all components by default according pedro latest update.You will see this option when u just do
# ./ctools-installer.sh
will prompt will required parameters.
see here for details:
https://github.com/pmalves/ctools-installer/pull/5

Profile Photo
Commented by Yogaraj Khanal
on January 9th, 2012 at 00:23:18 EST
I haven't tested 3.9 extensively.I use 3.8 and 3.10 mostly but shouldn't be any issues according to my understanding.You can try these version to find out if its issue with 3.9.Try standalone version of Saiku too if you are just looking for just Saiku.
http://analytical-labs.com/


Profile Photo
Commented by Fz Harm
on April 15th, 2012 at 19:32:42 EST
Hello!
Thank you for your tutorial!
But I still have problem, I followed all steps bellow but I had the same thing as Edwin Allen, Just a small icon of CDE but no Saiku.
I'm working with Pentaho 3.10 CE. An other thing ,I noticed that the main pentaho menu that I get isn't the same as in your figure:1. I have just two icon:"New Report" and "New Analysis".

Profile Photo
Commented by Yogaraj Khanal
on April 19th, 2012 at 21:58:56 EST
Fz,
Latest CTOOLS installer will install all the C** Tools i.e. CDE,CDA,CDF,CCC and Saiku please follow pedro docs on it.They are pretty straight foward.
The image that I have shown above are for version 3.8.
In version 3.10 you will get just two icons without installing CTOOLS.
Please try this and let me know if you still have issues.

Profile Photo
Commented by Yogaraj Khanal
on April 19th, 2012 at 22:00:47 EST
Also the commands parameters are slightly changed in the latest CTOOLS installer that what I have documented above but are pretty straight forward to figure out.Try it out you should be able to see all CTOOLS including Saiku after running the installer.

Profile Photo
Commented by Avinash Kumar
on May 29th, 2012 at 05:42:04 EST
Hi Yogaraj,
I have pasted the ctools-installer.sh file in the Cygwin terminal. It did run in a flash and I started BI server after it. But it did not help. I could only see the 'new report' and 'new analysis' icon on the home page.
Pls help.
- Avinash

Profile Photo
Commented by Yogaraj Khanal
on June 11th, 2012 at 12:50:40 EST
I think you didn't provide enough parameters to the ./ctools-installer.sh
There is also help option available that shows you what arguments are required.
If you try that should work flawlessly. Give one more shot and let me know if you still have issues.
You said you pasted somethings but was not clear to me. You are supposed to run the command not paste contents from file. Cd to that directory and run the commands.Hope that helps.

Profile Photo
Commented by Waltenio Mendes
on June 11th, 2012 at 20:55:34 EST
Yogaraj this article helped me so much. But a have a question: before install ctools/pentahoServer BI 3.10.0 stable I had installed Apache Tomcat 7. Now when I enter
http://localhost:8080/pentaho I got error 404 pentaho not available. I see in
pentahoServer folder a subdirectory named Tomcat with application Tomcat6.
How to solve this question?
Thanks for help

Profile Photo
Commented by Waltenio Mendes
on June 11th, 2012 at 21:07:10 EST
Yogaraj this article helped me so much. But a have a question: before install ctools/pentahoServer BI 3.10.0 stable I had installed Apache Tomcat 7. Now when I enter
http://localhost:8080/pentaho I got error 404 pentaho not available. I see in
pentahoServer folder a subdirectory named Tomcat with application Tomcat6.
How to solve this question?
Thanks for help

Profile Photo
Commented by
on June 12th, 2012 at 10:26:27 EST
Yogaraj this article helped me so much. But a have a question: before install ctools/pentahoServer BI 3.10.0 stable I had installed Apache Tomcat 7. Now when I enter
http://localhost:8080/pentaho I got error 404 pentaho not available. I see in
pentahoServer folder a subdirectory named Tomcat with application Tomcat6.
How to solve this question?
Thanks for help

Profile Photo
Commented by
on June 12th, 2012 at 10:27:24 EST
Yogaraj this article helped me so much. But a have a question: before install ctools/pentahoServer BI 3.10.0 stable I had installed Apache Tomcat 7. Now when I enter
http://localhost:8080/pentaho I got error 404 pentaho not available. I see in
pentahoServer folder a subdirectory named Tomcat with application Tomcat6.
How to solve this question?
Thanks for help

Profile Photo
Commented by Yogaraj Khanal
on June 27th, 2012 at 13:03:18 EST
Seems like Tomcat or port issue.
Can you change port no or remove 7 and just try with 6
To change port see this post.


Profile Photo
Commented by
on August 2nd, 2012 at 22:46:16 EST
Hi Yogaraj, Thank you for this tutorial
i have installed CTOOLS using Cygwin on Pentaho BI version 3.7.0.GA.44216
installing files is done and no issue
the screen shot of Fig VII that shows, and i try to create New CDE Dashboard...
worksheet new CDE Dashboard layout shows but all of menu is not working.
any suggest for this issue?

Thanks
David

Profile Photo
Commented by David Andriansyah
on August 3rd, 2012 at 00:39:37 EST
for worksheet New Saiku Analytics
i got error on page:

Webpage error details
User Agent: Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; InfoPath.2; .NET4.0C; .NET4.0E)
Timestamp: Fri, 3 Aug 2012 04:33:02 UTC

Message: Expected identifier, string or number
Line: 40
Char: 2
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf-dd/getcomponentdefinitions

Message: 'undefined' is null or not an object
Line: 1
Char: 1802
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf-dd/getJsResource/resources/ace/src/ace.js

Message: 'cdfdd.components' is null or not an object
Line: 48
Char: 30
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf-dd/NewDashboard

Message: 'cdfdd.datasources' is null or not an object
Line: 49
Char: 30
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf-dd/NewDashboard

Message: Can't move focus to the control because it is invisible, not enabled, or of a type that does not accept the focus.
Line: 1382
Char: 7
Code: 0
URI: http://localhost:8080/pentaho/content/dashboards/script/pentaho-dashboard-controller.js

Message: Object doesn't support this property or method
Line: 583
Char: 3
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf/js/Dashboards.js

Message: 'cdfdd' is null or not an object
Line: 36
Char: 1
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf-dd/NewDashboard

Message: 'cdfdd' is null or not an object
Line: 36
Char: 1
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf-dd/NewDashboard

Message: 'cdfdd' is null or not an object
Line: 37
Char: 1
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf-dd/NewDashboard

Message: 'cdfdd' is null or not an object
Line: 36
Char: 1
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf-dd/NewDashboard

Message: 'cdfdd' is null or not an object
Line: 37
Char: 1
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf-dd/NewDashboard

Message: 'cdfdd' is null or not an object
Line: 36
Char: 1
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf-dd/NewDashboard

Message: 'cdfdd' is null or not an object
Line: 36
Char: 1
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf-dd/NewDashboard

Message: 'cdfdd' is null or not an object
Line: 37
Char: 1
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf-dd/NewDashboard

Thanks,
David

Profile Photo
Commented by David Andriansyah
on August 3rd, 2012 at 02:15:26 EST
for worksheet New Saiku Analytics
i got error on page:

Webpage error details
User Agent: Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; InfoPath.2; .NET4.0C; .NET4.0E)
Timestamp: Fri, 3 Aug 2012 04:33:02 UTC

Message: Expected identifier, string or number
Line: 40
Char: 2
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf-dd/getcomponentdefinitions

Message: 'undefined' is null or not an object
Line: 1
Char: 1802
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf-dd/getJsResource/resources/ace/src/ace.js

Message: 'cdfdd.components' is null or not an object
Line: 48
Char: 30
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf-dd/NewDashboard

Message: 'cdfdd.datasources' is null or not an object
Line: 49
Char: 30
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf-dd/NewDashboard

Message: Can't move focus to the control because it is invisible, not enabled, or of a type that does not accept the focus.
Line: 1382
Char: 7
Code: 0
URI: http://localhost:8080/pentaho/content/dashboards/script/pentaho-dashboard-controller.js

Message: Object doesn't support this property or method
Line: 583
Char: 3
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf/js/Dashboards.js

Message: 'cdfdd' is null or not an object
Line: 36
Char: 1
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf-dd/NewDashboard

Message: 'cdfdd' is null or not an object
Line: 36
Char: 1
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf-dd/NewDashboard

Message: 'cdfdd' is null or not an object
Line: 37
Char: 1
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf-dd/NewDashboard

Message: 'cdfdd' is null or not an object
Line: 36
Char: 1
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf-dd/NewDashboard

Message: 'cdfdd' is null or not an object
Line: 37
Char: 1
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf-dd/NewDashboard

Message: 'cdfdd' is null or not an object
Line: 36
Char: 1
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf-dd/NewDashboard

Message: 'cdfdd' is null or not an object
Line: 36
Char: 1
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf-dd/NewDashboard

Message: 'cdfdd' is null or not an object
Line: 37
Char: 1
Code: 0
URI: http://localhost:8080/pentaho/content/pentaho-cdf-dd/NewDashboard

Thanks,
David

Profile Photo
Commented by Yogaraj Khanal
on August 3rd, 2012 at 15:32:56 EST
@David,
The icons that you see in figure VII are for version 3.8 in latest version they have changed the layout. Are you able to resolve the other error?can you do update and try again not sure how you are getting this.
they might have temporary bugs too. if problem persists in their distribution i recommend you to drop your question here where they monitor the issues more frequently.

Profile Photo
Commented by Yogaraj Khanal
on August 3rd, 2012 at 15:33:06 EST

Profile Photo
Commented by David Andriansyah
on August 5th, 2012 at 21:13:31 EST
@Yogaraj,
thanks for the answer
i just following the tutorial and download cda,cde,cdf installer latest from http://ctools.webdetails.org and then i installed.
how i drop my question here, i have reported that post to admin to be delete.

thank you very much
regards,
david

Profile Photo
Commented by Shikha T
on October 3rd, 2012 at 07:08:29 EST
@Yogaraj,
Thanks for sharing excellent tutorial.
I have followed the tutorial and made similar dashboard using CDE in community edition. But, I want to use this dashboard in enterprise edition. I have read in one forum (http://forums.pentaho.com/showthread.php?129176-Export-dashboards-created-with-CTOOLS)that it is possible to integrate ctools with enterprise edition. If so please explain the steps or provide any other alternative.

Thanks,
Shikha

Profile Photo
Commented by Yogaraj Khanal
on October 3rd, 2012 at 17:32:47 EST
@Shikha,
I haven't used EE version just doing dashboard on CE.
But should be the same process according to my understanding.
Are you getting any specific issues after trying to integrate.

Profile Photo
Commented by Shikha T
on October 4th, 2012 at 04:55:02 EST
@Yogaraj,

I followed the same integration.Now, it is working :)

Thanks

Profile Photo
Commented by Srinu Ravuri
on October 19th, 2012 at 03:44:13 EST
Hi sir

i am srinu presently i am new to pentaho reporting please tell me which version and how to install on linux(o.s) please send me to ravuri.cnu@gmail.com


Profile Photo
Commented by Yogaraj Khanal
on October 19th, 2012 at 08:10:59 EST
Srinu,
This is the tutorial I wrote to run Pentaho on Windows Environment.
In Linux there shouldn't be any issues.
If you just started I recommend that you read their docs and study their examples how it works and what are it capabilities.
Hope that provides some insight.Also I have some demo examples and some explanation when I was exploring it. I will be happy to answer if you have any questions on those.

Profile Photo
Commented by Marcos Branquinho
on February 1st, 2013 at 14:30:06 EST
Hi Yogaraj Khanal!
I've followed the steps you've designed but my version of Pentaho did not worked as it sould be... Probably it would be the version I'm using (BI Server CE 4.5 and 4.8).

I've downloaded the installers that are quite different and the main window of Pentaho just don't show the CDE, CDC, etc links above... Do you know what I'm probably doing wrong?

Thanks in advance!

See ya Marcos

Profile Photo
Commented by Yogaraj Khanal
on February 4th, 2013 at 09:59:16 EST
The new installer takes these parameters make sure you provide the correct path:
Usage: ctools-installer.sh -s solutionPath [-w pentahoWebapPath] [-b branch]

-s Solution path (eg: /biserver/pentaho-solutions)
-w Pentaho webapp server path (requiresd for cgg, eg: /biserver-ce/tomcat/webapps/pentaho)
-b Branch from where to get ctools, stable for release, dev for trunk. Default is stable
-y Assume yes to all prompts
-h This help screen

Profile Photo
Commented by Rajesh C
on August 1st, 2014 at 09:28:35 EST
Hi Yogaraj,
This is my ctools installer script.
./ctools-installer.sh -s /cygdrive/c/users/vm/desktop/pentaho/software/biserver-ce-5.1.0.0-752/biserver-ce/pentaho-solutions -w /cygdrive/c/users/vm/desktop/pentaho/software/biserver-ce-5.1.0.0-752/biserver-ce/tomcat/webapps/pentaho -b /cygdrive/c/users/vm/desktop/pentaho/software/biserver-ce-5.1.0.0-752/biserver-ce/pentaho-solutions

When I run this script, Im getting this below error
ERROR: Branch must either be stable or dev

May I know, How should I give whether the branch is stable or dev?