Informatica Power Center – A Quick Introduction

August 9th, 2010 by Robert McMillen • No Comments

PowerCenter is a collection of software tools to support extraction, transformation and loading (ETL) of data between multiple applications.  Most companies prefer to use Informatica Power Center to populate their data warehouses with operational data.  However, Power Center also simplifies the process of integrating data between different applications in either a batch or near-real-time manner.

A common problem in most companies is that information exists in silos and it can be difficult to custom design and implement ways to keep data synchronized between applications.  The options are to write custom integrations or use tools to automate and simplify the process.  Since such integrations invariably change as applications are updated, there are regular needs to revisit the integration and update it.  The point-and-click capabilities of PowerCenter Designer along with it’s WorkFlow Manager dramatically simplify and speed up the creation and maintenance of these data integrations.

PowerCenter has the ability to work with data in just about any situation.  It can access data in Excel spreadsheets, any relational database (Oracle, SQL Server, MySQL, DB2, Sybase), web applications (SalesForce) and even flat files (CSV).

PowerCenter consist of several related applications as shown here.

PowerCenter Components

PowerCenter relies on Mappings and Workflow.  Mappings describe the inputs, transformations and outputs of the data.  Transformations can eliminate data, enrich the data, organize organize the data in different ways.  If you have ever worked with SQL or Microsoft Excel you are probably familiar with the many functions that PowerCenter uses to transform data.  In addition the software supports sophisticated Joins, Unions, Sorts, Aggregations, Routing and Look-ups which are simple to define and implement.

A Workflow process is then created and used to organize one or more mappings.  Within a workflow, the developer can check for error conditions, issue email updates, synchronize processes so they execute in the right order and schedule how and when a mapping process is executed.

All of the PowerCenter information is stored in a database repository (such as Oracle) where multiple developers can access the information and collaborate on new integrations.  The repository can also be used to secure the integration information and support the reuse of mappings, transformations and even workflows.  The focus on “reuse” allows very complex processes to be built, over time, by grouping simpler mappings that have been previously tested and approved.

The client tools that come with Power Center are top-notch.  They provide a very intuitive interface for designing and debugging integration processes quickly.  Several sample screens are shown below.  They allow you to drag-n-drop the data components and data flow on the screen and then quickly test the results using test data.  The PowerCenter debugger supports step-by-step review of a complex mapping by showing the states of variables and data elements.

Here is a PowerCenter Designer screen example.

PowerCenter Designer

Here is a portion of a Mapping that has been defined for data integration.  It was created using drag-n-drop components.

Sample Mapping

When you are finished with the mapping, you can then create complex workflows with many different mappings and steps.

Simple Workflow

Here at SSG, we use PowerCenter to help our clients quickly integrate applications so that they can share data or create the ETL to load their data warehouses quickly and efficiently.  By leveraging PowerCenter’s capabilities we are able to provide faster and more robust solutions compared to a traditional custom programming solution.

For more information about Informatica, you can visit their website here.

If you enjoyed this post, make sure you subscribe to my RSS feed!

No Comments

 

Oracle APEX and BI Publisher

August 9th, 2010 by Robert McMillen • No Comments

I recently worked on a project that involved an Oracle APEX application.  If you aren’t familiar with APEX, it’s  a database-centric rapid application development product that is included with the Oracle 10g and 11g databases.   Using APEX you can generate web-based applications, interact with database tables/views, leverage PL/SQL stored procedures and even integrate it with Oracle BI Publisher.  BI Publisher is an easy-to-use report generation product.

One of our requirements was to generate reports from the application in a PDF format.  I looked at several options and decided for the moment that Oracle BI Publisher was the fastest and simplest solution.  Fortunately the client was happy with that as well.

What I found out was that generating a report from APEX and having it printed as a PDF via BI Publisher is a very elegant solution.  Beyond installing BI Publisher on a server, the following steps were what I need to do.  BTW, we installed BI Publisher in both the windows and Linux environments with no issues.

We had an existing application screen and wanted to generate the PDF using the same underlying SQL queries.  First I logged into the APEX application, went to SHARED COMPONENTS and defined multiple SQL select statements using the REPORT QUERIES option.  I was able to reference some existing session variables to customize the SELECT statements.  In APEX I was able to define a REPORT LAYOUT template under the SHARED COMPONENTS.  Then I downloaded the BI Publisher plug-in for Microsoft Word 2007 and created a report template.  There’s more detail in that process than I can cover here, but it didn’t take long for me to learn how to create more and more complex templates.

I was then able to upload the template to APEX (and download it later for editing).  Since the templates are MS Word documents, it’s pretty straight-forward.

Back in APEX I modified the logic on one of the application web pages to add a button.  This button was linked to a BRANCH statement which called BI Publisher and generated the PDF Report.  Within a few seconds my browser had a download of the PDF file which I could open and browse!

Within several weeks we had created about a dozen reports, each with 5 or 6 SQL queries.  Some executed directly out APEX and others were scheduled to run directly from BI Publisher on an automated schedule.  If you want to learn more about the link between APEX and BI Publisher, here are some examples.  Happy Report Writing!

Defining a PDF Report in APEX

If you enjoyed this post, make sure you subscribe to my RSS feed!

No Comments

 

Premier Support Extended for Fusion Middleware 10gR2 (10.1.2)

April 29th, 2010 by Robert McMillen • No Comments

Just noticed that Oracle has decided to extend Premier support for Fusion Middleware for an additional year. 

For those who want the basics, Oracle is extending Premier support for one additional year. 

Are you confused about when Premier, Extended and Sustaining support dates occur for your Oracle Software? 

It’s easy to end that confusion.  You can find out more about Oracle’s support policies for Fusion Middleware and other products by visiting this page Lifetime Support Policy: Oracle Fusion Middleware Products and viewing the available pdf files.

With this change, Extended Support for Fusion Middleware  10gR2 is no longer needed or available.  When this year of support ends, the choices are to upgrade to a newer version or move to Sustaining support, which is available indefinitely.

If you enjoyed this post, make sure you subscribe to my RSS feed!

No Comments

 

Collaborate ’10: Best Practices for DW on Oracle

April 22nd, 2010 by Paul Scott • No Comments

I attended an excellent presentation give by Maria Colgan, Sr. Product Manager at Oracle. The title was ‘Best Practices for a Data Warehouse on Oracle’.

Great tuning tips encompassing the entire architecture of a DW — hardware, network, storage, and of course, Oracle DB.

A whitepaper version of the presentation may be found on the OTN website:

http://www.oracle.com/technology/products/bi/db/11g/pdf/twp_dw_best_practies_11g11_2008_09.pdf 

I highly recommend.

If you enjoyed this post, make sure you subscribe to my RSS feed!

No Comments

 

Collaborate ’10: Oracle Data Warehouse updates

April 20th, 2010 by Paul Scott • No Comments

At Collaborate 2010, I attended a presentation given by Ray Roccaforte, VP of Data Warehouse Development at Oracle.

The focus of presentation was on three areas:

  • The Exadata machine
  • In Database Analytics
  • Industry Analytics Solutions Sets

My key take away is that Oracle is committed to be a solution provider rather than just a software products company.

The Exadata machine is all about delivering a packaged solution for data warehouse environments. Hardware and software bundled together ready to go. What’s interesting is that Oracle is now pushing down a lot of the performance improvements to the storage level and not trying to do everything in the Oracle database.

Also, Oracle has rewritten the optimizer to take advantage of the 5TB of flash (yes … 5 terabytes!).

In addition to the “data warehouse machine”, Oracle is also building data models for specific industries.

Retail and Telco are the first to to roll out. They include multi-dimensional data models and prebuilt reports to jump start any BI initiative within that industry.

If you enjoyed this post, make sure you subscribe to my RSS feed!

No Comments

 

Congratulations OAUG on your 20th Anniversary!

April 20th, 2010 by Robert McMillen • No Comments

Last night at Collaborate 2010, there was a special event to recognize the 20th anniversary of the Oracle Applications User Group.  All of the past presidents, except those trapped in Europe because of that pesky Icelandic volcano, were in attendance.

Starting with a small group of four or five customers, the OAUG has grown to encompass over 1200 companies as members.  At Collaborate, the OAUG joins together with two other user groups, the IOUG and Quest to provide the best in user learning and interaction.  The IOUG focuses more on the technical side of databases and development.  Quest includes users who specialize in PeopleSoft.

There are sessions on applications, middleware, databases, integration, business intelligence, data warehousing, tuning, implementation, planning and upgrading.

This week there are dozens of sessions covering every Oracle application you can think about along with Bootcamp sessions with hands-on opportunities to try your hand with new software.  Down in the Exhibit Hall, all of the significant vendors are there to answer questions and show their latest product features.  Oracle has a large area where you can talk to specialists about their products.  Want to understand what more about an Oracle product?  They will fill you in on the details.  Want to know how it can help your organization?  They will provide that too.

Unlike Oracle Open World, OAUG is less “sales-oriented” and more learning-oriented.  The focus is on meeting like-minded users and sharing your best lessons learned.  While not widely used, the term “collegial” probably best applies to this gathering.

If you haven’t tried Collaborate, you are missing more than you know.  Add it to your calendar for next year.  It will be in Orlando so starting working on your tan!

If you enjoyed this post, make sure you subscribe to my RSS feed!

No Comments

 

PL/SQL Frameworks, what’s that?

April 20th, 2010 by Robert McMillen • No Comments

I attended an interesting session today at Collaborate 2010 that focused on using pre-built frameworks for PL/SQL development.  I hadn’t really thought much about this area but it definitely made sense as began to understand the context.

In most development environments there are frameworks of code that offer basic functionality that developers typically need.  For example, a framework might include routines for logging, error-handling, messaging, and unit-testing.  Frameworks provide a head start for developers because they provide essential functions that are robust and tested.  This reduces development and testing for common processes that are used over and over.  Reuse is one of those buzz words that really make sense.  Frameworks epitomize the best in “reuse”.

PL/SQL which is procedural language for SQL is one the most popular languages for developing stored procedures that execute within the Oracle database.  They are fast, powerful and efficient.  Using PL/SQL allows developers to develop complex functionality that executes quickly in the database memory and which can reduce the workload for application developers who won’t need to develop lots of SQL queries.

Many years ago I supported a group of developers in this way.  I developed multiple packages that they could call with simple queries.  My packages did complex joins for tables and then provided them the resultsets.  This approach allowed them to focus on the user interaction while I handled the business logic and data.

Bill Coulam, the speaker at this particular presentation, has developed a PL/SQL framework that he is offering at no-cost on SourceForge.  He calls it PLSQL Starter.  His is not the only framework available but it has many of the basics that most companies should consider.

If you would like to download Mr. Coulam’s product and read his documentation, you can find it here.

And if you are interested you can look at Pluto which is a PL/SQL framework that is more focused on unit testing.  You can find it here.

If you enjoyed this post, make sure you subscribe to my RSS feed!

No Comments

 

Update on new version of Oracle Enterprise Manager 11g

April 20th, 2010 by Robert McMillen • No Comments

Previously I noted that Oracle Enterprise Manager (OEM) 11g will be released this coming Thursday.  At lunch today I spoke with a member of the team that has been working on this new release of OEM at Oracle.

In response to my question about what he felt was one of the best new features, he said it was that the new release of OEM will now support monitoring and management of Middleware software.  I was pleased to hear that since it has been one area where Enterprise Manager has not had much impact.  I don’t have any more details on what that that entails but stay tuned and we will both find out on Thursday!

If you enjoyed this post, make sure you subscribe to my RSS feed!

No Comments

 

New Version of Application Integration Architecture for 11gR1

April 20th, 2010 by Robert McMillen • No Comments

On Thursday I will presenting on Application Integration Architecture here at Collaborate 2010.  Interestingly, I’m already having to update my presentation because of Oracle’s new announcement.  Isn’t change fun?

Previously Application Integration Architecture (AIA), which is at Version 2.5, was fully compatible with Fusion Middleware 10g.  With this new release, AIA is fully compatible with the new Fusion Middleware 11g.  Oracle has released a few details with their announcement.

Oracle has added to the collection of Enterprise Business Objects and Services.  They have also added more functionality which is listed in their Press Release here.

This is all of the information that I have as of now but I will update the blog as more becomes available.  In the meantime, I will be posting my presentation (if it is not already there…) with the updated version later this week.

If you enjoyed this post, make sure you subscribe to my RSS feed!

No Comments

 

OBIEE Hands On Workshop

April 19th, 2010 by Steve Steinheimer • No Comments

I am learning how to create many of the visualizations available with the Oracle Answers product – a component of OBIEE.  During the workshop I created several charts, reports, pivot tables and even a ticker.   For my first time playing with the OBIEE front end tools I found them very intuitive and fun to use.

If you enjoyed this post, make sure you subscribe to my RSS feed!

No Comments