Permissions: Users must have RBM, Data Central, and Study Configure privileges to configure a study for RBQM.
RBQM (Risk Based Quality Management) is configured for a study within Data Central Configuration.
A study must be RBQM & RACT enabled for RBQM configuration to be available in Data Central Configuration.
Access Data Central Configuration
From a study card on the Data Central landing page, either click the red triangle (displayed if the study is not yet configured), or the Configuration icon, then select Data Central Configuration.
The Data Central Configuration window for the selected study opens. Click RBQM in the left navigation to access each configuration item.
Configurations can be copied from another study, imported, or exported.
Expand the Global and Study section using the RBQM down arrows. Initially, the overview window displays 'Complete Configuration,' but each section within Global and Study requires configuration.
Global configurations apply to all the RBQM studies within the URL; study-specific configurations apply only to the selected study.
Important: Any edits or deletions at the Global level apply to every study in the URL.
Clicking Global in the left navigation displays the Global configuration overview.
Clicking Study in the left navigation displays the Study configuration overview.
Configure Global Categories
A set of standard global categories is available by default: Data Quality, Essential Documents, Investigational Product, Issue Management, Safety, Staffing, Facilities and Supplies, and Subject Recruitment and Discontinuation. These categories form the initial organizational layer for indicators.
Categories can be added, edited, or deleted as needed and are client-specific.
In the left navigation, click Categories under Global.
Add a Global Category
- Click the Add icon (the plus sign) in the top right corner.
- Enter the name of the new category in the Name field.
- Click Save. This adds the category to the global list and will be available to all RBQM studies across the URL.
Edit a Global Category
- Click the category Name you want to edit.
- Edit the Name of the category.
- Click Save. The updated category displays in the list of Categories.
Delete Global Category(ies)
- Click in the box at the left of the category(ies) you want to delete.
- Click the Delete icon (the trashcan) in the top right corner.
- A confirmation window opens. Click OK (or click Cancel to cancel your action).
- Click Save.
Configure Global Actions
Use Global Actions to configure actions that may be assigned to different indicators at the Study level. A set of default Actions display, but Actions can be added, edited, deleted, or disabled.
In the left navigation, click Actions under Global.
Add a Global Action
- Click the Add icon (the plus sign) in the top right corner. A new row is added at the top of the list.
- Enter the name of the new action in the Name field.
- Click Save. The new action is added to the end of the list.
Edit a Global Action
- Click the Action name you want to edit.
- Edit the Name of the action.
- Click Save. The updated action displays in the list of Actions.
Delete Global Action(s)
- Click in the box at the left of the action(s) you want to delete.
- Click the Delete icon (the trashcan) in the top right corner.
- A confirmation window opens. Click OK (or click Cancel to cancel your action).
Global Actions in use cannot be deleted. A warning message displays; click the 'x' to close the message and cancel your actions. - Click Save.
Disable Global Action(s)
Actions marked as disabled are not available in the drop-down when assigning to different indicators at the Study level. Disabled actions stop firing future KRI and QTL issues.
- Click in the box in the Disabled column of the action(s) you want disabled. To re-enable action(s), uncheck the box(es) in the Disabled column.
- Click Save.
- A confirmation window opens. Click OK (or click Cancel to cancel your action).
Configure Global Indicators
Global Indicators identify the Category, Name, and Description of a possible Key Risk Indicator. Indicators are used to determine how risky an activity is; they provide an early signal of increasing risk exposures in the various categories. Global Indicators can be added here and will be available across the URL for all RBQM studies.
In the left navigation, click Indicators under Global.
Add a Global Indicator
- Click the Add icon (the plus sign) in the top right corner. A new row is added at the top of the list.
- Select the Category from the Category drop-down.
- Enter the name of the new indicator in the Name field.
- Click Save. The new indicator is added to the end of the list.
Edit a Global Indicator
- Click the Indicator name you want to edit.
- Edit the Category, Name, or Description of the Indicator.
- Click Save. The updated indicator displays in the list of Indicators.
Delete Global Indicator(s)
- Click in the box at the left of the indicator(s) you want to delete.
- Click the Delete icon (the trashcan) in the top right corner.
- A confirmation window opens. Click OK (or click Cancel to cancel your action).
Global Indicators in use cannot be deleted. A warning message displays; click the 'x' to close the message and cancel your actions. - Click Save.
Configure Study CTQs
CTQs, or Critical to Quality Factors, are essential tools for ensuring study reliability, integrity, and regulatory compliance by managing quality and risk. While not required, adding CTQs is recommended. They are added manually; if none are added, the 'View CTQ' toggle on the study dashboard will be disabled.
Add and Define a Study-Level CTQ
- From the CTQ Factors list, click the Add icon (the plus sign) in the top right corner. The New CTQ window opens.
- Enter the CTQ name in the Name field.
- Select the Category from the drop-down.
- Select one or more associated Acceptable Range(s) (QTL) from the drop-down.
- Enter the Description.
- Status: By default, Active is selected. Being active, it will run when new data are refreshed.
- Click Save.
Edit a Study-Level CTQ
- Click in the row of the CTQ you want to edit.
- Click the Edit icon. The Edit CTQ window opens.
- Make changes as needed.
- Click Save.
Delete a Study-Level CTQ
- Click in the row of the CTQ you want to delete.
- Click the Delete icon (the trashcan).
- A confirmation window opens. Click OK (or click Cancel to cancel your action).
- Click Save.
Configure Study QTLs
QTLs, or Quality Tolerance Limits, are used to measure the health of a study. They can be imported from the Global Library or added manually for each study. Configured QTLs can be promoted to the Global Library to be used across studies. For details on using the Global Library for QTLs and KRIs, see the section within this article Use the Global Library to Promote or Import QTLs and KRIs.
In the left navigation, click Quality Tolerance Limits (QTLs) under Study. Added QTLs are displayed in the list with columns for Name, Description, Category, CTQ, and Active status.
Add and Define a Study-Level QTL
- From the list, click the Add icon (the plus sign) in the top right corner. The New Quality Tolerance Limits (QTL) window opens, displaying the General window.
General
- Enter the QTL name in the Name field.
- Select the Category from the drop-down.
- Enter the Description. The entered description will display when a user hovers over a QTL gauge.
- Status: By default, Inactive is selected. Click the toggle to activate it so that it will run when new data are refreshed.
- By default, Show current threshold is selected (the threshold line will be a straight line based on the current threshold). Select Show dynamic threshold for the threshold line to update when a change to the threshold is made.
Study Scoring - Click Study Scoring in the left navigation.
- Enter the Study Query, the SQL statement.
- Click the Validate button to validate the query. Modify query as needed.
- Click Save.
Risk Levels / Actions
- Click Risk Levels / Actions in the left navigation.
Tolerance Limits
- Enter the Tolerance Limits for Upper Limit, Approaching Upper Limit, Approaching Lower Limit, and Lower Limit. The In Control (exclusive) limit will be automatically populated.
- Edit checks are in place to identify if overlapping values are entered. When Save is clicked, an error message may display, click the 'x' to close the message and update the values.
- As values are entered, the Gauge Preview on the right will update so you can see what the configured gauge will look like. Update the Sample Score by using the slider.
Study Risk Actions: Tolerance Exceeded / Approaching Limit / In Control / Approaching Limit
Apply actions if a QTL has met Tolerance Exceeded. - Click one of the Tolerance Limits to create a Study Risk Action for that limit.
- Click the Add icon (the plus sign).
- Click in the Name field and select the action from the drop-down (as configured in Global Actions).
- Enter the number of days in the Due in Days field in which this action should be completed once the QTL enters the risk level.
- Click in the Trigger field and select from the drop-down: Always (i.e. when the score exceeds a threshold a system generated issue will always be generated), When Changed From Previous (i.e. when you want the action to display only when there is a change in the score; the change could be a higher or lower risk), or When Riskier Than Previous (i.e., when you want the action to display only if the score results in a higher risk level).
- Click in the Assign To field and select from the drop-down: Data Central role Site Monitor (default) or select from the list.
Supporting Data
- Click Supporting Data in the left navigation.
Supporting data can be defined by adding to the Domains section. Domains added as supporting data in configuration are available in the QTL dashboard.
- Click the Get From Query icon in the Domains area to add a domain from the Study Query (in Study Scoring). If no Study Query is entered, an error message displays.
- Click the Add Domain icon in the Domains area to add from the drop-down list of available domains. Use the scrollbar to access all domains.
- Continue adding as needed.
- Click the Preview Domain icon (the magnifying glass) next to a domain to view the domain listing in the Preview window.
- To remove a domain, click the Delete icon next to a domain.
Save QTL Configuration
- Click Save at the bottom right. The new QTL is added to the list.
Important: If items are not configured correctly, an error message with details will display. Read the message carefully, then click the 'x' to close it and correct the item(s).
Edit a Study-Level QTL
- Click in the row of the QTL you want to edit.
- Click the Edit icon. The Edit QTL window opens.
- Make changes as needed.
- Click Save.
Delete a Study-Level QTL
- Click in the row of the QTL you want to delete.
- Click the Delete icon (the trashcan).
- A confirmation window opens. Click OK (or click Cancel to cancel your action).
- Click Save.
Note: QTLs used in a Risk Action Plan within RACT cannot be deleted; a message will appear indicating this.
Configure Study KRIs
In the left navigation, under Study, click Key Risk Indicators (KRIs). Added KRIs will display in the list of Indicators, with columns for Name, Description, Category, Country (checked if a Countries query exists), Site (checked if a Sites query exists), Weight, Uses CSM (checked if a CSM calculation is applied), Active (checked if active), and Global (checked if assigned from the Global KRI library).
The list is initially empty. Global Indicators can be assigned to your study using the pre-defined Category, Name, and Description; they can be imported from the Global Library or added manually. Configured KRIs can be promoted to the Global Library for use across studies. For details on using the Global Library for QTLs and KRIs, see Use the Global Library to Promote or Import QTLs and KRIs in this article.
Add and Define a Study-Level KRI
When adding an indicator at the study level, it is only available for that study and does not appear at the global level.
- From the Indicators list, click the Add icon (the plus sign) in the top right corner. The New Indicator window opens.
General - Enter the KRI name in the Name field.
- Select the Category from the drop-down.
- Enter the Description.
- Update the Status: By default, Inactive is selected. Click the toggle to activate it so that it will run when new data are refreshed.
- Update Critical Vs. Not Critical: By default, KRI is Not Critical is selected. Click KRI is Critical to mark the KRI as critical. If a site exceeds the threshold for a KRI defined as critical, the entire site will be flagged as yellow / red, regardless of the overall site score.
- Update the Weight if needed (1 is default).
Scoring
Optionally, use CSM or Z Score for scoring.
- Click Site Scoring in the left navigation.
- Optionally, check Use CSM (Central Statistical Monitoring). CSM is a method to identify sites statistically different from the 'central' site. (In RBQM, the 'central' site is defined as an aggregate of all sites.) If checked, additional fields display.
- Select the CSM Type from the drop-down: Continuous, Discrete, or Proportion.
- Select the CSM Alpha Value from the drop-down: .1, 0.05, 0.01, 0.001, 0.0001, 0.00001, or 0.000001.
- Optionally, add the CSM Measurement Label.
- Enter the Sites Query.
- Click the Validate button to validate the query. Modify query as needed.
- Continue to Risk Levels, Step 13.
- Optionally, check the is Z Score box, if there is a Z Score calculation required for this indicator.
In order to use a Z-Score for a given Key Risk Indicator (KRI), the KRI should not be categorical, such as a yes / no variable or 1=mild, 2=moderate, 3=severe. Further, the values of the KRI should not be skewed, meaning the majority of the values should not sit at the high end or the low end within a narrow range with data trailing off to the opposite side. As an example, think of a study where few adverse events are found in subjects. If most of the subjects have 0 events, with a handful having anywhere from 1-10 events, this is not ideal for a z-score. Lastly, there should be at least thirty observations associated with the KRI in order to get meaningful results with a Z-Score. - Enter the Sites Query, the SQL statement to call the max risk value for each site for the selected indicator. This is a required entry.
- Click the Validate button to validate the query. A table displays the Site ID, Site Score, and Z-Score (if is Z Score is selected). Modify query as needed.
Site Risk Levels / Actions
Enter Limits. For example, when looking at enrollment numbers, the lower the number, the higher the risk. Or you may have an AE rate that is too high or too low (e.g., there is a good band in between). - Click Risk Levels / Actions under Site Scoring in the left navigation.
- Enter the Site Risk Levels. The Low will be automatically populated.
- Edit checks are in place to identify if overlapping values are entered. When Save is clicked, an error message will display, click the 'x' to close the message and update the values.
- As values are entered, the Gauge Preview on the right will update so you can see what the configured gauge will look like. Update the Sample Score by using the slider.
Site Risk Actions: High
Apply actions if an indicator exceeds the limit.
- Click one of the Site Risk Levels, i.e., High (Upper), Medium (Upper), Low (exclusive), Medium (Lower), or High (Lower).
- Click the Add icon (the plus sign).
- Click in the Name field and select the action from the drop-down (as configured in Global Actions).
- Enter the number of days in the Due in Days field in which this action should be completed once the indicator enters the risk level.
- Click in the Trigger field and select from the drop-down: Always (i.e. when the score exceeds a threshold a system generated issue will always be generated), When Changed From Previous (i.e. when you want the action to display only when there is a change in the score; the change could be a higher or lower risk), or When Riskier Than Previous (i.e. when you want the action to display only if the score results in a higher risk level).
- Click in the Assign To field and select from the drop-down: Data Central role Site Monitor (default), or select from the list.
- Continue adding Site Risk Actions for each Site Risk Level as needed.
Supporting Data - Click Supporting Data under Site Scoring.
Supporting data can be defined by adding to the Domains section. Domains added as supporting data in configuration are available in the KRI dashboard.
- Click the Get From Query icon in the Domains area to add a domain from the Sites Query (in Site Scoring). If no Sites Query is entered, an error message displays. Click the 'x' to close the message.
- Click the Add Domain icon in the Domains area to add from the drop-down list of available domains. Use the scrollbar to access all domains.
- Continue adding as needed.
- Click the Preview Domain icon (the magnifying glass) next to a domain to view the domain listing in the Preview window.
- To remove a domain, click the Delete icon next to a domain.
- Click Country Scoring in the left navigation.
- Enter the Countries Query, the SQL statement to call the max risk value for each country for the selected indicator. This is a required entry.
- Click the Validate button to validate the query. Modify query as needed.
Country Risk Levels / Actions
Enter the Country Risk Levels limits. For example, when looking at enrollment numbers, the lower the number, the higher the risk. Or you may have an AE rate that is too high or too low (e.g., there is a good band in between).
- Click Risk Levels / Actions under Country Scoring in the left navigation.
- Enter the Country Risk Levels limits. The Low will be automatically populated.
- Edit checks are in place to identify if overlapping values are entered. When Save is clicked, an error message will display, click the 'x' to close the message and update the values.
- As values are entered, the Gauge Preview on the right will update so you can see what the configured gauge will look like. Update the Sample Score by using the slider.
Country Risk Actions: Low/ Medium / High
Apply actions if an indicator falls within a certain risk level.
- Click one of the Country Risk Actions, i.e., High (Upper), Medium (Upper), Low (exclusive), Medium (Lower) or High (Lower).
- Click the Add icon (the plus sign).
- Click in the Name field and select the action from the drop-down (as configured in Global Actions).
- Enter the number of days in the Due in Days field in which this action should be completed once the indicator enters the risk level.
- Click in the Trigger field and select from the drop-down: Always, When Changed From Previous (i.e. when you want the action to display only when there is a change in the score; the change could a higher or lower risk), or When Riskier Than Previous (i.e. when you want the action to display only if the score results in a higher risk level).
- Click in the Assign To field and select from the drop-down: Data Central role Site Monitor (default), or select from the list.
- Continue adding Country Risk Actions for each Country Risk Level as needed.
Supporting Data - Click Supporting Data under Country Scoring.
Supporting data can be defined by adding to the Domains section. Domains added as supporting data in configuration are available in the KRI dashboard. - Click the Get From Query icon in the Domains area to add a domain from the Countries Query (in Country Scoring). If no Countries Query is entered, an error message displays. Click the 'x' to close the message.
- Click the Add Domain icon in the Domains area to add from the drop-down list of available domains. Use the scrollbar to access all domains.
- Continue adding as needed.
- Click the Preview Domain icon (the magnifying glass) next to a domain to view the domain listing in the Preview window.
- To remove a domain, click the Delete icon next to a domain.
Save KRI Configuration - Click Save. The new KRI is added to the list; note that the 'Global' column is not checked. This column will be checked if a global indicator was brought into the study.
Edit a Study-Level KRI
- Click in the row of the Indicator you want to edit.
- Click the Edit icon. The Edit KRI window opens.
- Make changes as needed.
- Click Save.
Delete a Study-Level KRI
- Click in the row of the Indicator you want to delete.
- Click the Delete icon (the trashcan).
- A confirmation window opens. Click OK (or click Cancel to cancel your action).
- Click Save. This is just removing the Indicator from this study; it is not deleting a Global Indicator.
Note: KRIs used in a Risk Action Plan within RACT cannot be deleted; a message will appear stating this.
Assign Global Indicators to the Study
- From the Indicators list, click the Assign icon in the toolbar. The Assign Indicator window opens. The Global Indicators are grouped by the Global Categories.
- Check any of the Global Indicators to be assigned to the study.
- The Indicator displays in the list and Global is checked.
Configure Study Sites
For site-level monitoring, the sites table must be loaded; otherwise, configuration cannot continue. The example below shows a correctly entered Sites query.
In the left navigation, click Sites under Study. The SQL Query for Sites window displays.
- In the empty field, enter the SQL statement that identifies from where the Sites table should be pulled. This statement includes the study, staging area, and then the table name. It must also have the country code for every site in order to enable country functionality with RBQM.
Tip: Notice there is an underscore between the study name and the staging area, and a period between the staging area and the table name. For example: Select SiteName Name,SiteNumber as SiteId, NULL Address , City,State,null as Zip,Country From ALXN1210_aHUS_311_CTOA.[Sites] where sitename is not null
-
Click the Preview button. The bottom section of the window populates with the Sites table. If this does not display as expected, modify the SQL statement.
- Click Save when the preview of the Sites table is as expected.
Sites SQL Statement
|
SQL Portion
|
Required SQL
|
Location
|
|---|---|---|
| Study Name | Schema Prefix |
From the ETL tab when study is in Edit mode: |
| Staging Area | Schema Suffix |
Administration > Configuration > Staging Areas (click to edit the staging area): |
| Table Name | Table Name |
At the study level, click Exporter and select the Staging Area with the table to see the name: Note: To ensure you are seeing the correct name, be sure your My Profile is set to Names. |
If the site information is not available from the Operational data, import an .xlsx or .txt file with the site information into elluminate, typically into the Operational staging area. The table should include the Site ID and Location (city, state, zip, country). See below for an example:
Configure Study Actions
Use the Study > Actions to configure study-level actions. These pull from the Global Actions.
In the left navigation, click Actions under Study.
The list of Actions is displayed in Low, Medium, and High sections. Actions at the study level can be added and deleted.
Add a Study-Level Action
- Click the Add icon (the plus sign) in the top right corner within the section (low, medium, high) where you want to add the action.
- Click in the Name field and select the action from the drop-down (as configured in Global Actions), or manually enter an Action (it will automatically be entered to Global Actions).
- Enter the Due in Days field in which this action should be completed once the QTL or KRI enters the risk level.
- Click in the Trigger field and select from the drop-down: Always, When Changed From Previous (i.e. when you want the action to display only when there is a change in the score; the change could a higher or lower risk), or When Riskier Than Previous (i.e., when you want the action to display only if the score results in a higher risk level).
- Click Save.
Note: Actions added at the study level will appear in the global list.
Edit a Study-Level Action
- Click the Action name you want to edit.
- Edit the Name of the action, Due in Days, and / or Trigger.
- Click Save. The updated action displays in the list of Actions.
Delete Study-Level Action(s)
- Click in the box to the left of the action(s) you want to delete.
- Click the Delete icon (the trashcan) in the top right corner.
- A confirmation window opens. Click OK (or click Cancel to cancel your action).
- Click Save.
Use the Global Library to Promote or Import QTLs and KRIs
In addition to creating a study level QTL or KRI (or assigning a Global KRI), it is also possible to utilize the Global Library in elluminate to share configured QTLs and KRIs between studies. The options are to promote a QTL / KRI to the Global Library and import a QTL / KRI from the Global Library. The process is the same for both QTLs and KRIs.
Promote a QTL / KRI
Promoting a QTL or KRI to the Global Library will make it available to other studies in the same URL / environment.
- From the list of QTLs / KRIs, click the row to be promoted.
- Click the Global Library button. The drop-down options are Promote to Global Library and Import From Global Library.
- Select Promote to Global Library. The Promote to Global Library window opens.
- Library Title: By default, this is auto-filled with the name of the QTL /KRI.
- Description: By default, this is auto-filled with the description in the QTL / KRI.
- Tags: Optionally, enter a comma separated list of tags that can be used to find QTLs / KRIs when importing from the Global Library.
- Folder: Select the folder where the QTL / KRI will be located. The Home folder is selected by default. Users with the Global Library Configure privilege can also create, modify, or delete folders.
- Scope: Select the Scope by clicking the down arrows to expand the Therapeutic Areas, Compounds, and Programs sections and checking the box(es) to make your selections. User the scrollbar at the right of each category to see all items listed. The selected Scope defines which studies will have the QTL / KRI available.
- Click Save.
Import a QTL / KRI from the Global Library
- From the list of QTLs / KRIs, click the Global Library button. The drop-down options are Promote to Global Library and Import From Global Library.
- Select Import From Global Library. The Import From Global Library window opens.
- Enter a New Name.
-
Optionally, use the Filter Library Objects. By default, the filter automatically applies attributes of the current study, so the user sees the most applicable available QTL / KRI objects. The number in the blue badges indicate the number of selected items in each area (TA, Compounds, Programs). Additional filters can be applied, or filters can be removed.
- Click the down arrows to expand the Therapeutic Areas, Compounds, and / or Programs sections.
- Check the items you wish to filter.
To reset the filter, click Reset.
The window updates based on your selections. Notice the blue badges update to the number of filtered objects displayed. - Find the QTL / KRI object within the folder structure, or use the Search field to filter the list, to be imported. Use the scrollbar to see all items.
- Click the QTL / KRI object to be imported.
- Click Save.
Tip: Once the QTL is imported and appears in the list of Tolerance Limits, update its attributes accordingly for the study.