Posts

Continuation Of The Previous Blog (Creating Multiple Sheets In A Single Excel File Using Talend)

-
Image
This blog is in continuation of the previous blog, i.e.  Creating Multiple Sheets In A Single Excel File Using Talend .  The job design for creating multiple sheets in a single sheet can give you errors when dealing with a large set of data. We will generally encounter A Zip Bomb Detection . This can be resolved by using a tJava component with the code as mentioned below: The Code:  org.apache.poi.openxml4j.util.ZipSecureFile.setMinInflateRatio(-1.0d); You can use the tJava component and can trigger the next Subjob as mentioned in the previous blog using OnComponentOk or OnSubjobOk. This will resolve the issue and the job will work fine with the large set of data.
Post a Comment
Read more

Creating Multiple Sheets In A Single Excel File Using Talend

-
Image
This blog is about a simple but tricky Talend job where we will be generating 1000 Sheets in one single Excel file using just 1 single record and 1 single sheet as an input.  The idea of this job is to create a file with 1000 sheets wherein we will be duplicating just one single record in all the sheets. Note : The records in different sheets can be changed as well. (If we have to follow a pattern in the change required) The input and output will be as follows: Input >                                                                  Output > We have used one more file (Number Sequence File) which will provide us the range from 1 to 1000. This will help in running the job 1000 times.  ( A file with a single column and 1000 rows, starting from number 1 to 1000) The components used in the Job are as follows: tFi...
Post a Comment
Read more

Common Questions Related to Databases And Talend

-
In this blog, we have tried to cover some basic questions related to Database (Mainly SQL) and Talend. A PowerPoint presentation has been added to this blog to have a better understanding of the topics mentioned below: Data Warehouse: What do you understand by Data Warehouse, Data Lake, and Data Mart? What are Facts and Dimensions? Conformed Dimensions. SCD Types and their Examples. SQL – Databases: What are SQL Joins? Window Functions. Performance Tuning of SQL Queries. Views and Materialized Views. Talend: Talend Match Model in tMap. Context Groups. Error Logging Methodology in Talend. Joblets and Shared Routines. Memory Management. Performing UPSERT onto a table via a job/ and when two keys are involved? Scenario-Based: What is your understanding of ELT or ETL? Talend job design approach. Ways to tune a Talend job that has too many lookups. What do you...
Post a Comment
Read more

Data Integration with Salesforce & Talend

-
Image
Simply put, data integration is the process of combining data from different internal and external sources into a single, centralized repository. For example, a company may have customer data stored in a legacy database, manage inventory data with a third-party platform, and collect still other data through other applications that, at one time, may have been the best option. Situations such as these are not uncommon. As companies grow and change, so too do their software and data needs, and a strategy that once made sense needs to be revised. That’s where data integration comes in. At the heart of data integration is the ETL (extract, transform, load) process. Data integration begins with extracting data from various sources and moving it into a single data warehouse. (For companies and organizations who do not use a data warehouse, the process is similar, although the data will be integrated directly into the source.) In order to facilitate the integration process, Salesforce...
Post a Comment
Read more