Data Translation Services
Data Translation Services (DTS) is a Data Analytics tool for Ivanti® Management Suite that scans your organization's devices for the inventory data you most care about, such as software licensing, warranties, and so on. Once the data is scanned into the inventory database, you can customize, aggregate, and organize it in reports to make informed and practical decisions about hardware and software purchases and needs.
The power of DTS is found in its rules, which enable you to scan for much of the device data that's important to your IT work. DTS installs with numerous default rules that will likely address most of your IT needs, though you can configure your own rules to perform customized tasks as well. When you configure a rule and run it, you're enabling DTS to perform a task such as retrieving warranty data from a vendor website or pulling data from Active Directory. Once that information is in the inventory database, you can use it for customized reporting.
In this topic:
About the Data Translation Services view
About the Data Translation Services view
When you open DTS, a pane appears across the bottom of the Management Suite console. This pane consists of a tree structure that lists various folders, most of which are used to store the different rule types.
Most of the folders also have right-click menus that you can use for various tasks, such as configuring, editing, or running rules, importing/exporting rule data as .XML files, and so on. You can also use the toolbar for many of these same tasks.
From the toolbar, you can complete the following tasks:
- Refresh list: Refreshes the tree view.
- Edit properties: Allows you edit the properties of a rule. You can edit only the rules you create on your own. With system-generated rules, you must first copy the rule and then edit it.
- Delete: Deletes a rule or group folder and its contents. You can only delete rules you create on your own, not system-generated rules.
- Toggle active/inactive: Makes a rule active or inactive. By making a rule active, the rule automatically runs when the core server receives the scan file. You also need to ensure that the Enable Real-time Processing is on at the DTS toolbar.
- Schedule: Schedules a rule to run now or at a later time against the inventory database. The Schedule icon remains dimmed until you highlight a rule in the DTS tree view. Once you schedule the rule to run, a script is created in the Management Suite console's Scheduled Tasks. The script name is normally <rulename>_<rule idn>.ini. If you want to change the scheduled settings, go into Scheduled Tasks and modify it there. Rules don't have to be active in order to schedule them.
- Export configurations: Exports a rule configuration to an .XML file.
- Import configurations: Imports a rule configuration .XML file into the inventory database.
- Run order: Sets the run order for your active rules. The top rule runs first, and the others follow in descending order. Use the arrow keys to change the run order. Only rules set to active appear on this list.
Run order is important, because some rules are dependent on other rules for information. For example, if you're interested in obtaining warranty data for your Dell devices, you would first run a Dell Warranty rule to scan the data initially into the database, and then run the Last Warranty End Date rule to scan more specific data about that warranty. - Model attributes: A tool that "models" data usually handled by a catch-all table where unknown or “unmodeled” data in the database is placed. You can model the unmodeled data to its own normalized table for users unfamiliar with SQL or the schema of the database.
- Settings: Turns on/off the Data Analytics software manager service scan that runs the licensed software rules for all vendors. This service runs nightly on the core server when network activity is low.
Because the service is resource intensive and can take hours to complete, by default it's turned on at your child core servers and turned off on your rollup servers. We recommend the default, which ensures your inventory data will be current during your regularly scheduled rollup. - Enable/disable real-time processing: Enables or disables active mode for rules. Active mode causes a rule to run when the core server receives the scan file. To enable active mode, right-click a rule to set it as "active" and ensure that Enable Real-time Processing is on at the DTS toolbar.
Folders are described below in the order they appear in the tree list.
- Favorites: Organizes the rules you consider favorites. Drag and drop rules into this folder.
- Active: Organizes rules by "active" status, which means they run nightly during the Data Analytics core processor service scan. By default, DTS ships with an active subset of rules that provides data for a number of reports. When you set a rule as active, it automatically appears in this folder as well as remaining in its original folder.
- All types: Contains a list of folders that represent all available rule types.
- System groups: Organizes rules by system type. Drag and drop rules into the appropriate system group folder, where you can run them all at once.
- User groups: Organizes rules by the user groups you've defined. Drag and drop rules into the appropriate user group folder, where you can run them all at once.
The rest of the folders contain rule types. Most of the folders ship by default with rules already configured in their All Rules folders.
You may find that the following list of folders is incomplete. The weekly Ivanti content update service will occasionally publish new folders that aren't currently in the product.
- Aggregate data: Creates a rule that performs counts on one-to-many database attributes.
If the source attribute is a number, the rule will total the values of the attribute; for example, counting the available storage of a logical drive will return the total storage available on all computer logical drives. If the source attribute is not a number, the rule will count how many records exist and return the number in the destination attribute; for example, counting removable logical drives will total the number of those drives found on all computers. - Archive asset: Creates a rule that removes active assets from inventory while archiving a backup copy of the records in Asset Control. Often necessary for policy or legal reasons.
- B2B connector: Creates rules that retrieve data— such as purchase history or software license information—from external vendor websites such as CDW or Microsoft.
- Barcode CSV import: Creates a rule that automatically copies a .CSV file from your barcode scanner or other source for import into inventory.
- Barcode web group: Creates a rule that organizes barcode web forms into logical or functional groups.
- Barcode web form: Creates a web form for importing device barcode data into inventory.
- Bulk input: Creates a spreadsheet for entering custom data "in bulk" for new and existing device inventory records.
- Calculate data: Creates a rule that uses VBScript to combine multiple database attributes to return a single value or do other operations.
- Enterprise aggregators: Creates a rule that imports data from various enterprise databases into inventory so that you can analyze it using Data Analytics.
- Export data: Creates a rule that exports data to SQL, ODBC, Oracle, or .CSV files.
- Import data: Creates a rule that imports data from SQL, ODBC, Oracle, or .CSV and Excel files.
- LDAP import: Creates a rule that enables DTS to connect to an LDAP source and import data into inventory. Data Analytics ships with a number of these rules by default. However, you may want to modify them to gather additional or customized data. An LDAP browser is included to help you find the information you need.
- LDAP export: Creates a rule that enables DTS to connect to a LDAP source and export data from inventory to that source.
- Licensed software: Creates a rule that groups software products together by shared license information, showing exactly how many licenses you need to be compliant.
- Map data: Creates a rule for manipulating data, such as copying a database attribute from one place to another. Data Analytics ships with a number of these rules by default. However, you may want to modify them to gather additional or customized data.
- Map list: Creates a rule for creating a new database attribute based on a different attribute. For example, if you have a number of subnets in your network, each one can be mapped to a particular city. You can then map each default gateway to a city.
- Normalize: Creates a rule for normalizing inventory data by standardizing the names for hardware, software, or vendors to make the data reportable.
- Software license import: Creates a rule that imports software license data from external sources (such as .CSV or Excel files, ODBC, Oracle, or SQL) into the Management Suite software license monitoring (SLM) tool.
- SQL command: Creates a rule that directly writes SQL to modify the inventory database. You can enter any valid SQL command or series of commands.
- Web import: Creates a rule for collecting data from the Internet or an intranet and importing it into inventory. You can specify a vendor website to go to and the information to gather. The most popular of these rules perform manufacturer warranty look-ups, and ship by default with Data Analytics.
- Web custom data: Creates a web form for importing custom device data into inventory.
- VMWare vCenter import: Creates a rule that imports information about VMWare ESX servers and virtual devices from a vCenter database into inventory.
- Datacenter product: Creates a rule that modifies detected licensed software based on a vendor's advanced licensing policies. For example, running SQL Server in a virtual environment requires comparisons between the host and virtual images to determine the actual license that is most cost effective.
Most of the tree-view folders have right-click menus that you can use for various tasks, such as configuring or editing rules, scheduling rules to run, importing/exporting groups or rule data as .XML files, and so on.
The following items are a global list of right-click menus, and they're listed alphabetically. Not all menu items are available for all folders.
- Add group: Creates a group folder that you can use for organizing rules; drag and drop the rules from other folders into this new one. Grouping is useful for running a series of rules together.
- Add licensed software to SLM: Manually runs the Data Analytics software manager service to add product license data to Management Suite’s software license monitoring (SLM) console. The same service runs automatically each night. We recommend that you do not run this process manually unless necessary—it’s resource intensive and could take several hours to complete.
- Add root group: Creates a group folder, at the root of the tree view, that you can use for organizing rules. Drag and drop the rules from other folders into this new one. Grouping is useful for running a series of rules together.
- Add software license lookup entry: Allows you to add a software product to the software license look-up table. The lists that are built for vendor, product, and version come from the licensed software rules. When running a license import, if you receive the message “Product is not defined for row xyz,” the product was not defined in the look-up table, and you must add it.
- Assign computer groups: Lets you use computer groups to limit the scope of a software license. These are groups that you've already defined in the database using the software license monitoring (SLM) tool.
- Assign LDAP groups: Lets you assign licensed software to LDAP groups, ensuring that users in those groups are counted in license compliance. By assigning LDAP groups, you have a way to track license usage accurately in a Citrix or Terminal Server VDI-licensing environment where users remotely access software and aren't using a device with the Ivanti agent installed.
- Copy: Creates a copy of a rule in the same group folder. You can then rename and edit the copy.
- Delete: Deletes a rule or group folder and its contents. You can only delete rules you create on your own, not system-generated rules.
- Delete licensed software data: Completely deletes software data from the inventory database for all devices. This data won't appear again in inventory until you create a new rule that enables the Data Analytics software manager service to detect it again during a scan.
- Delete software license lookup entry: Allows you delete a software product from the software license look-up table.
- Disable/enable group: Disables a group and its rules from running as part of the nightly Data Analytics software manager service scan. When a group is disabled, the service skips that group and doesn’t run its rules.
This feature is useful if the default rules for a vendor don't represent the specific license agreement your organization has with that vendor. For example, if you have a deal with Microsoft that's different from their standard license downgrade rights, you can disable the Licensed Software > All Vendors > Microsoft group and create a new group called "YourCompany Microsoft." In that group, you would configure new rules that are specific to your organization's use of Microsoft products, reflecting the true nature of your license agreement with Microsoft. - Edit: Allows you edit the properties of a rule. You can edit only the rules you create on your own. With system-generated rules, you must first copy the rule and then edit it.
- Export: Exports a rule as an .XML file. To export multiple rule configurations, select them in the list view and click Export.
- Export computer groups: Exports your SLM-defined computer groups as an .XML file for use in another database's software license look-up table, which is useful in a multi-core environment. Use computer groups to limit the scope of a software license.
- Export group: Exports a group folder as an .XML file, which is useful in a multi-core environment. This action doesn't export the group's rule configurations, just the definition of which rules are in the group. You must export the rule configuration files separately.
- Export LDAP groups: Exports an LDAP group as an .XML file, which is useful in a multi-core environment.
- Export software license lookup information: Exports data from the software license look-up table, which is useful in a multi-core environment.
- Import computer groups: Imports your SLM-defined computer groups as an .XML file from another database's software license look-up table, which is useful in a multi-core environment. Use computer groups to limit the scope of a software license.
- Import group: Imports a group folder from an .XML file, which is useful in a multi-core environment. This action doesn't import the group's rule configurations, just the definition of which rules are in the group. You must import the rule configuration files separately into the target databases; otherwise, you'll be importing an empty group folder.
- Import LDAP groups: Imports an LDAP group from .XML file, which is useful in a multi-core environment.
- Import software license lookup information: Exports data from the software license look-up table, which is useful in a multi-core environment.
- Modify approved software: Enables you to choose which products are part of the corporate standard for your network environment by setting the Computer.Software.Licensed Software.Approved attribute to "Yes." This setting is useful when you want to ensure all devices are standardized and running company-approved software.
- New rule: Opens a wizard for creating a new rule configuration.
- Run now: Runs the selected rule immediately.
- Schedule: Schedules a rule to run as a task against the inventory database. The task will show up in the DTS Scheduled folder, and a script is created in the Management Suite console's Scheduled Tasks. The script name is normally <rulename>_<rule idn>.ini. If you want to change the scheduled settings, go into Scheduled Tasks and modify them there. Rules don't have to be active in order to schedule them.
- Set active/inactive: Sets a rule as active, so that it will run when an inventory scan is received (keeping your inventory data as current as the last inventory scan). When you set a rule as active, you'll be prompted to run it against the entire inventory database to update the data for existing devices; we recommend that you do this. Once a rule is set as active, it automatically appears in the Active folder.
Active mode also requires you to turn on Enable Real-time Processing at the DTS toolbar. - Set group run order: Sets the run order for rule configurations in this group. The top rule runs first, and the others follow in descending order. Use the arrow keys to change the run order.
Run order is important, because some rules are dependent on other rules for information. For example, if you're interested in obtaining warranty data for your Dell devices, you would first run a Dell Warranty rule to scan the data initially into the database, and then run the Last Warranty End Date rule to scan more specific data about that warranty. - Set targets: Lets you specify which types of devices a rule runs against. For example, you wouldn't run a Dell warranty rule on HP devices. A target can be a device group, individual devices, queries, scopes, or any combination of these.
- Show all licensed software detected: Shows an up-to-date list of all scanned, licensed software.
Getting started
To obtain inventory data and then view it in report format, you'll use both the DTS and the Executive Report Pack (ERP) tools. Use DTS to configure and run the rules that determine the type of data that's scanned into the inventory database, and use ERP to create a variety of reports that are useful for lifecycle management, software compliance audits, and so on.
Understanding rules
You'll likely find that the default rules shipped with DTS (called system-generated rules) are comprehensive enough to begin creating the reports you're most interested in viewing. For a comprehensive list of supported rules, see Supported rules, connectors, and vendors.
DTS ships with two kinds of rules:
- The licensed software rules, listed under Licensed Software > All Rules, gather information about software licensing that you'll want for reporting. By default, these rules run collectively each night during the Data Analytics software manager service scan and are turned off only if you disable a vendor group from being part of the scan.
You also have the option of running these rules on demand or as a scheduled task, either by vendor group or individually. To see licensed software rules specific to a vendor, click Licensed Software > All Vendors. - All other rules, not related to software licensing, gather information from various sources that could also be of value to you. You'll find these rules in the various folders of the DTS tree view, and by default, most are inactive. Only a subset of the most commonly used rules install as active.
To run these rules, you can do so manually, as a scheduled task, or set them as "active." By setting a rule as active, it will appear in the Active folder and will run when an inventory scan is received.
The Ivanti content update service, which publishes Data Analytics updates on a weekly basis, regularly overwrites the existing system-generated rules. New system-generated rules, reports, column sets, and so on are also published during these updates.
Running rules
You can run rules three different ways:
- As a scheduled task: Create a script that schedules a rule to run by right-clicking the rule and selecting Schedule. The script you create will appear in the Management Suite console's Scheduled Tasks, and the name is normally <rulename>_<rule idn>.ini. If you want to change the scheduled settings, go into Scheduled Tasks and modify them there.
- By manually activating: Run a rule manually by right-clicking it and selecting Run Now to run it on all devices. Or, with some rules, you can drag and drop a device, group, or query from the Management Suite console onto the rule in the DTS console view. This action opens a dialog where you can specify that the rule runs against just those devices.
- By setting as "active" for real-time processing: Set a rule as active so it runs when an inventory scan is received. You can turn on active mode by right-clicking a rule and selecting Set Active. Once a rule is active, it automatically appears in the Active folder. For active mode to work, you must also enable real-time processing. To do this, make sure the Enable Real-time Processing stoplight is green on the DTS toolbar.
To set a rule as inactive, right-click it and select Set Inactive. DTS will automatically remove the rule from the Active folder. The rule will still exist in its original group folder.
Both scheduled and manually-activated rules run directly against the inventory database.
When real-time processing is enabled, the Ivanti inventory service receives the scan file from a device and writes it with an .MP extension. The Data Analytics core scan processor service then picks up the scan file and runs all active rules against it. After completion, the service puts the scan file back in the LDScan folder as a .SCN file and the inventory service processes it.
For performance reasons, a rule will only run against a scan file if the source data for it is in the scan file. For example, most of the web warranty rules are looking for the System.Serial Number attribute. When a device first sends a scan file, it contains all the data about the device. At that point the serial number should be in the scan file and the rule will run. However, subsequent scans from the same device are normally delta scans (only changes are sent). Since the serial number does not normally change, the rule will not run.
When you set a rule as active, you'll be prompted to run it against the entire inventory database to update the data for existing and new devices; we recommend that you do this. Once a rule is set as active, it automatically appears in the Active folder.
For more information, see About the core scan processor service
Assigning targets
With most rules, you can specify which types of devices or "targets" the rule runs against. For example, you would only run a Dell warranty rule on Dell devices, not HP devices. A target can be a device group, individual devices, queries, scopes, or any combination of these.
- Right-click the rule and select Set Targets.
- Drag an item from the right (Available Devices) to the left (Selected Devices).
- Select Check database only if you want the query to check the database but not run against the scan file. This option is important if the attributes being used are not in the scan file, such as data brought in by other rules that may not have run.
- Click OK.
Viewing reports
By default, Data Analytics installs with multiple reports already defined. You can view these reports by opening the Executive Report Pack tool. From an IT perspective, the most valuable reports are the ones showing software licensing compliance, though many other types of reports are also available.
- In the Data Analytics toolbox, open Executive Report Pack.
- In the tree view, click ERP > Software Compliance. You'll find several reports to choose from in this folder.
For more information about ERP, see Executive Report Pack.
Configuring new rules
The power of DTS is found in its system-generated rules, which enable you to scan for a wide variety of device data that's important to your IT work. At some point, you may want to configure new rules. DTS has numerous wizards that lead you through the process of creating a rule. These wizards are accessible via the tree view by right-clicking any of the folders and selecting New Rule.
For descriptions of the rules you can configure, see About the Data Translation Services view.
The rules you will most commonly need that may not ship by default with Data Analytics involve merging records, normalizing data, and managing licensed software. The following sections describe those rule types.
Merging records
One key feature of DTS is the ability to use a barcode form or B2B connector to create a "stub" record for a device that doesn't yet exist on your network. For example, when you receive a computer at your loading dock, you can scan the barcode on the box, and DTS will create the stub record in the database. Then, depending on the manufacturer, DTS may pull additional information from the web about the device. After you put the device on the network with an installed Ivanti agent, this stub record is merged with the normal inventory record.
Stub records are stored in the following places:
- For devices that can be managed, such as computers, they're stored in the inventory database.
- For a non-agent device, such as a printer, they're stored in Asset Control.
- For a software license, they're imported into Management Suite's software license monitoring (SLM) tool.
Rules for B2B connectors and barcode forms merge stub records automatically. Below is a description of the process.
B2B connector merging
The various B2B connectors are designed to pull information about your devices from the web and add that information into inventory. For example, if you purchase devices from CDW, you can create a B2B connector rule for CDW that can pull purchase information such as the price, P.O. number, and so on. B2B connectors can also create new stub records to show devices you have ordered but have not yet installed with the Ivanti agent.
When a B2B connector rule creates a record, it assigns the Computer.Scan Type as Vendor Import. It also assigns the serial number (or other numbers for certain vendors) to the Computer.Barcode field. A service then runs on the core server looking for all records of Computer.Scan Type Vendor Import. It checks the Computer.Barcode against all other devices to see if a device with a different scan type exists.
An important point is that by default, the Ivanti agent does not report a Computer.Barcode value. When DTS is installed, a system-generated rule is also installed that can populate this field. If you plan on merging records, it's best practice to run this rule manually (located in Calculate Data > All Rules > Computer.Barcode). After comparing the barcodes for a match, the service copies only the stub record data that doesn't already exist into the inventory database. The stub record is then deleted.
For more information, see B2B connectors overview
Barcode merging
Barcode merging is similar to B2B merging. The main differences are that the Computer.Scan Type is set to Barcode, and it's not necessarily the Computer.Barcode field that's used to merge. Each barcode form has a link field. When a barcode rule creates a device record, the Computer.Barcode Configuration attribute is populated with the name of the rule that added it.
When the service performs its merge check, it looks for all devices with a Computer.Scan Type of Barcode. It then looks up the Computer.Barcode Configuration value for the device. The service reads the barcode form for the link attribute and searches the database for any non-barcode devices with the same link attribute value. If one is found, the records are merged in the same manner as for B2B connector devices.
For more information, see Barcode web-form wizard.
Normalizing data
For a variety of reasons, much of the data in your inventory database is not in report-ready format. Many vendors have few standards for naming their hardware, software, or company, making it difficult to create a clean report that shows all of the vendors and product versions you have installed. The inventory database can only report back what a device reports to it. A hardware vendor may report that its name is just "Vendor" on one device, “Vendor Inc.” on another device, and “Vendor Incorporated” on a third. By normalizing the data, you can make it more easily reportable.
For more information, see Normalize wizard
Managing licensed software
One of the most expensive aspects of an IT environment is the software. Using DTS to determine an accurate number of licenses your software products require can result in huge cost savings.
DTS uses a EULA-based method for determining which software products actually need licenses in your environment. For example, Microsoft may allow a license for Office 2010 Professional to also cover a copy of Office Professional 2007, but not a copy of Office Standard 2010. Regardless of how many of these “covered” copies of software exist on a device, you need only one license to be compliant. This is known as “effective licensing”—the number of licenses you need versus what you may have installed. DTS uses a flexible, query-based engine to determine effective licensing.
For more information, see Licensed-software rules overview