Teradata and XTIVIA - Your Data Warehousing SolutionBuilding Data Warehousing solutions on Teradata requires experience and expertise in leveraging its unique features. XTIVIA has wealth of experience in Teradata Solutions Implementation and our longstanding partnership with Teradata helps our professionals be current with new Teradata releases and latest trends. Our Teradata experts can help you implement and operate a mixed workload environment involving high volume batch data loads, tactical queries, analytical queries and real-time data integration. XTIVIA can help you leverage Teradata’s ability to process large volumes of structured and unstructured data in delivering insights to your end users.
Solutions Architecture & Development
- Teradata Physical Data Modeling
- Implement domain specific models
- Semantic Data Modeling
- Reporting and Analytics Implementation
- ETL/ELT design and development using Teradata Utilities, SQL, Procedures, Functions
- Application Maintenance
- Database Design
- Application Performance Tuning
- Teradata Managed Services
Our approach specific to Teradata Data Warehouse implementations is to take maximum advantage of Teradata parallel architecture and its performance features. Our experienced Teradata professionals work closely with end users and IT counterparts in understanding the current and future reporting, data storage, data movement, security and quality requirements in designing an optimal physical and semantic data model.
We closely work with clients to understand data integration requirements and SLAs in choosing appropriate Teradata load/unload utility (or appropriate Teradata Parallel Transporter operator) for the ETL / ELT. We implement ELT fully utilizing Teradata MPP architecture for relaxed data latency requirements (batch data warehouse updates) where the Data Warehouse is queried only after completely loading the data. For ADW needs, we implement an architecture that best suites the mixed workload requirements (real-time integration, adhoc, tactical queries, batch, analytics).
XTIVIA starts the design with a holistic and clean slate approach by fully understanding the pain points of the users and assessing the “data readiness”. Our architecture depends on the current state of data quality, data source location, estimated data volumes, application logic, performance, availability, data granularity, data storage, data archival and data consumption requirements. XTIVIA works with customers in coming up the success criteria and develops KPIs to validate the success during the course of implementation.
XTIVIA Accelerators and Frameworks
XDM (XTIVIA Data Warehouse Migrator)Using our experience in the Teradata Data Warehousing and Business Intelligence industry, we have built a wizard based accelerator XDM (XTIVIA Data Warehouse Migrator) that can be used to speed up the Data Warehouse Migration to Teradata with minimal cost. Speeding up the migration process helps organizations realize the benefits of capital investment made in procuring Teradata appliance. Please visit The XTIVIA Data Warehouse Migrator Innovation for more information.
XTIVIA Teradata DBA Tools
MVC Tool: An automated DBA tool for performing Multi-Value Compression to save space and improve performance. Teradata doesn’t provide any tool out of the box to define or create a list of values to be compressed for tables. Manual effort is involved in collecting candidate column values for compression. Not all data types can be compressed and there is a limit to the number of values that can be compressed. Our tool analyzes given tables and columns for the possibility of MVC and performs the MVC upon confirmation.
Table Skew Analyzer: An interactive command line tool to verify the skew and create modified DDL at runtime without changing the Primary Index physically on the table. This tool identifies table skew and allows the DBA to choose new columns at runtime and creates the DDL for deployment. Skew can be analyzed for all tables in a database in one go, for a particular table or at a given skew percentage. The tool does not change PI on the analyzed table but it sends out the new DDL (with changed PI) in an email.
Object DDL Comparison Tool: This is an automated tool to identify the DDL changes between different environments. Often DBA identifies the performance issues related to PI/PPI/Statistics being out of sync between environments. ETL developers also find the quality issues due to objects being out of sync. Our tool is designed to identify differences related to DDL, Primary Index, Partition Primary Index, Secondary Index and Statistics. The tool generates new DDL and a detailed report helping to sync up the environments.
Tuning Environment Creator: When approached for SQL performance tuning, DBAs usually spend lot of time in setting up the objects/statistics/data in order to not impact existing data and ongoing development and testing. Our tool automates this entire process and saves DBA time by automatically creating the required objects related to offending queries and copying data in a separate environment. Using this tool, a DBA can focus on actual tuning exercises instead of spending time copying objects and setting up environments for tuning.
Introduction to some new features (Teradata v 15.0, v 15.10)
Teradata JSON Support (v 15.0): Teradata added JSON support from v15.0 allowing the storage and processing of JSON objects in Teradata database. This allows schemaless reading and processing of semi-structured data. We can also publish the results of SQL queries in JSON format.
Teradata Directory Manager (v 15.0): Teradata provides a GUI tool TDM (Teradata Directory Manager) allowing easy mapping of Teradata objects to LDAP directory users. To use TDM, one needs to have a dedicated directory exclusively to be used by Teradata database. This reduces the impact on enterprise LDAP. TDM is available for free and supports all Teradata versions that can use Teradata 14 JDBC drivers.
Auto Provisioning (v 15.10): Effective v15.10, a database user is automatically created for external users (directory users not mapped to Teradata database user) upon their first login. In previous releases, a generic Teradata pseudo-user EXTUSER was used to identify external users which means individual user activity could not be logged and tracked. EXTUSER could not own database objects. With the Auto Provisioning feature, authentic LDAP users get quick database logon without Administrator’s intervention. This feature is turned off by default and it can be turned on by setting the DBSControl AutoProvision field to true.
Intelligent Memory Improvements (v 15.10): Teradata Intelligent Memory (optional feature) was introduced from v 14.10 and it helps automatically keep the hottest data in memory (VERYHOT cache) for faster data processing improving Operational Intelligence and tactical query workloads. This requires enough RAM on the node to support very large FSG cache. Changes to VERYHOT cache required tpareset but from v 15.10, DBA can adjust the FSG dedicated to VERYHOT cache without needing tpareset.
Partition-Level Locking (v 15.10): In earlier versions when DML operations were run on multiple rows within partitions of row-partitioned table, the lock is escalated to table level though the rows are being processed from fewer partitions. But now, Teradata locks only required partitions reducing the lock contention and improving concurrency.
Teradata Secure Zones (v 15.10): This optional feature allows organizations to create “zones” or partitions for separate (and may be unrelated) divisions on a single Teradata database. Users needing to access database objects within a particular “secure zone” need to have required access and privileges. Typical use cases include multi-tenant database services, regulatory compliance, large conglomerates needing access and control on multiple databases owned by unrelated subsidiaries.
New PI on Access Rights Table (v 15.10): Earlier versions of Teradata used to place table-level write lock on DBC.AccessRights table causing blocks and deadlocks when dropping and deleting objects. From v 15.10, Teradata has changed index (row partitioning) on the DBC.AccessRights table to reduce lock contention by placing partition-level or row-key level locks leading to improved performance on dropping and deleting objects.
No obligation, no pressure. We're easy to talk with and you might be surprised at how much you can learn about your project by speaking with our experts.
XTIVIA CORPORATE OFFICE
304 South 8th Street, Suite 201
Colorado Springs, CO 80905 USA
Additional offices in New York, New Jersey, Missouri, and Texas.
USA toll free: 888-685-3101, ext. 2
International: +1 719-685-3100, ext. 2
Fax: +1 719-685-3400
Complete the form to hear from us.