Common Questions Related to Databases And Talend

-

In this blog, we have tried to cover some basic questions related to Database (Mainly SQL) and Talend. A PowerPoint presentation has been added to this blog to have a better understanding of the topics mentioned below:

Data Warehouse:

  • What do you understand by Data Warehouse, Data Lake, and Data Mart?
  • What are Facts and Dimensions?
  • Conformed Dimensions.
  • SCD Types and their Examples.

SQL – Databases:

  • What are SQL Joins?
  • Window Functions.
  • Performance Tuning of SQL Queries.
  • Views and Materialized Views.

Talend:

  • Talend Match Model in tMap.
  • Context Groups.
  • Error Logging Methodology in Talend.
  • Joblets and Shared Routines.
  • Memory Management.
  • Performing UPSERT onto a table via a job/ and when two keys are involved?

Scenario-Based:

  • What is your understanding of ELT or ETL?
  • Talend job design approach.
  • Ways to tune a Talend job that has too many lookups.
  • What do you know about TMC?
  • Managing environments via TMC.

Comments

Post a Comment

Popular posts from this blog

Creating Multiple Sheets In A Single Excel File Using Talend

-
Image
This blog is about a simple but tricky Talend job where we will be generating 1000 Sheets in one single Excel file using just 1 single record and 1 single sheet as an input.  The idea of this job is to create a file with 1000 sheets wherein we will be duplicating just one single record in all the sheets. Note : The records in different sheets can be changed as well. (If we have to follow a pattern in the change required) The input and output will be as follows: Input >                                                                  Output > We have used one more file (Number Sequence File) which will provide us the range from 1 to 1000. This will help in running the job 1000 times.  ( A file with a single column and 1000 rows, starting from number 1 to 1000) The components used in the Job are as follows: tFi...
Read more

Continuation Of The Previous Blog (Creating Multiple Sheets In A Single Excel File Using Talend)

-
Image
This blog is in continuation of the previous blog, i.e.  Creating Multiple Sheets In A Single Excel File Using Talend .  The job design for creating multiple sheets in a single sheet can give you errors when dealing with a large set of data. We will generally encounter A Zip Bomb Detection . This can be resolved by using a tJava component with the code as mentioned below: The Code:  org.apache.poi.openxml4j.util.ZipSecureFile.setMinInflateRatio(-1.0d); You can use the tJava component and can trigger the next Subjob as mentioned in the previous blog using OnComponentOk or OnSubjobOk. This will resolve the issue and the job will work fine with the large set of data.
Read more