Posts

Showing posts from January, 2021

Creating Multiple Sheets In A Single Excel File Using Talend

Image
This blog is about a simple but tricky Talend job where we will be generating 1000 Sheets in one single Excel file using just 1 single record and 1 single sheet as an input.  The idea of this job is to create a file with 1000 sheets wherein we will be duplicating just one single record in all the sheets. Note : The records in different sheets can be changed as well. (If we have to follow a pattern in the change required) The input and output will be as follows: Input >                                                                  Output > We have used one more file (Number Sequence File) which will provide us the range from 1 to 1000. This will help in running the job 1000 times.  ( A file with a single column and 1000 rows, starting from number 1 to 1000) The components used in the Job are as follows: tFi...

Common Questions Related to Databases And Talend

In this blog, we have tried to cover some basic questions related to Database (Mainly SQL) and Talend. A PowerPoint presentation has been added to this blog to have a better understanding of the topics mentioned below: Data Warehouse: What do you understand by Data Warehouse, Data Lake, and Data Mart? What are Facts and Dimensions? Conformed Dimensions. SCD Types and their Examples. SQL – Databases: What are SQL Joins? Window Functions. Performance Tuning of SQL Queries. Views and Materialized Views. Talend: Talend Match Model in tMap. Context Groups. Error Logging Methodology in Talend. Joblets and Shared Routines. Memory Management. Performing UPSERT onto a table via a job/ and when two keys are involved? Scenario-Based: What is your understanding of ELT or ETL? Talend job design approach. Ways to tune a Talend job that has too many lookups. What do you...

Data Integration with Salesforce & Talend

Image
Simply put, data integration is the process of combining data from different internal and external sources into a single, centralized repository. For example, a company may have customer data stored in a legacy database, manage inventory data with a third-party platform, and collect still other data through other applications that, at one time, may have been the best option. Situations such as these are not uncommon. As companies grow and change, so too do their software and data needs, and a strategy that once made sense needs to be revised. That’s where data integration comes in. At the heart of data integration is the ETL (extract, transform, load) process. Data integration begins with extracting data from various sources and moving it into a single data warehouse. (For companies and organizations who do not use a data warehouse, the process is similar, although the data will be integrated directly into the source.) In order to facilitate the integration process, Salesforce...