Workflow creation in Informatica (Workflow Manager):
Once the mapping is created in the mapping designer, go to the “MAPPING” menu and select the option “VALIDATE”.
Once the above is completed go ahead with the workflow creation.
- Open up workflow manager and create workflow using the workflow menu.
- Open up workflow manager, go to Task developer and in the “tasks” menu and click on “CREATE” option.
- Create the session and name the session corresponding to the mapping name
s_ m_Stock_trading. - It will ask for the associated mapping select the mapping created and associate with new task created.
- On selecting the corresponding mapping the task will be created and click on done.
- Once the task and workflows are created. Go to the workflow designer and drag and drop the session (task created). So that we will be having the start symbol and the task (session) created.
- Go to tasks menu and click on link option and select the link from start to the session.
- Go to workflows menu and click on “VALIDATE” to make sure that the created workflow is valid.
Verifying records through Informatica (Workflow Monitor):
Once the workflow is validated, right click and click on start workflow. The session in the workflow will execute which can be monitored in the Workflow monitor. Once the session succeeds we can look for the properties and the transformation statistics. The same can be verified in the tables. By this, the expected records from external sources will be loaded in the target table.
Summary:
The stock data from the external source NSE and BSE are extracted as such into our SILO database for further processing using the extraction and parameter mapping. On extracting the external source data in to our staging database (NSE_TBL and BSE_TBL) it is further transformed as per the target needs using the loading mapping from NSE_TBL and BSE_TBL to STCOK_TRDING_FACT using the various look up tables. On executing the workflow corresponding to the session however after creating the valid session. Based on the successful execution of the workflow, the data will be loaded from the external sources to the STOCK_TRDING_FACT target table. The workflow could be scheduled at regular intervals in the workflow monitor or workflow manager in order to load the data from the external sources. The SLA (Service Level Agreement) could also be defined i.e. how long the workflow should run. If the execution time exceeds the defined SLA then performance tuning needs to be taken care.
Note: Informatica and its related products are Trademarks of Informatica Corporation. For more details, please visit their official website www.Informatica.com
