• Managing IOP Activity Files folder

    **This article is for ControlUp On-Premises customers only. 

    This article addresses the Activity Files folder only and how to manage it:
    As part of the IOP prerequisites, you define a shared folder for the activity files.
    If you want to find out the specific location of the "Activity Files" folder, on the ControlUp Server (OnPrem):

    Option #1 - Go into the Registry Editor > HKEY_LOCAL_MACHINE\SOFTWARE\Smart-X\ControlUpServer\IOP and see the path under the 'SharedFolder' key. 

    Option #2 - Log into Insights and go to Admin > Settings > Activity Folder. (see example below).

    2018-12-26_09-40-38.jpg

    :The files that are located in the Activity folder will look like the following image

    2018-12-26_09-38-15.jpg

    Creation and data flow to IOP:

    Stage #1 - Approx. every 30-35 minutes, the monitor exports the data it collected to the activity files shared folder. The file's size vary and is derived from number of monitored resources, meaning adding more machines to the console = amount of data rises in IOP.

    Stage #2 - The IOP engine detects that new files are located in the Activity folder and starts to index them. 

    Stage #3 - Once indexed successfully, the raw data can be found in the IOP DB, located here: C:\Program Files\Smart-X\ControlUp Insights\var\lib\splunk\cuiop

    NOTE: If you are experiencing high disk space usage on the Insights machine:

    By default, the activity files are NOT deleted. Remember, they are your backup of the data.

    Once the files were indexed, they will stay in the Activity Files folder until they'll be managed by the Administrator. Until that happens, the ControlUp Monitor will keep creating files in the Activity folder and after a while, the folder size will increase as well as the number of files in the folder.

    The best practice is once every week or two, to execute a backup procedure of the activity files in order to save space in the folder's directory and move the zipped activity files into a different secure location. 

    It's important to save the backed up zip files in a secure location to maintain the possibility of data recovery. If something happens to the Insights database \ machine, the Insights can always re-index the activity files again.

    NOTE: If the Activity Files files will be deleted - there's no option to recover them.
    ----------

    If you have any questions regarding the article - feel free to contact us at support@controlup.com 

  • How to manage your IOP index size

    **This article is for ControlUp On-Premises customers only. 

    IOP database can sometimes be larger than expected.

    In those cases it's either the machine ran out of disk space and the IOP displays an error or that the user has noticed that the machine takes a lot of disk space and he wants to check what's happening.

    The given DB size by default is 500GB, but it can be configured by the administrator.

    DB size can be in various sizes according to how long you want to save data backward.

    To know & calculate your DB size please follow the steps:

    1. Log into your organizational Insights  > Introspection details. 
    2. Look at the "Max daily index volume during time period" - that will show you how much data you're indexing per day. 

    daily.jpg

    3. Go to Settings > Index Management. There you'll see the Max DB Size which can            be configured.

    IndexMgmt.jpg

    For example, in a case that you're indexing 400MB~ per day and you want to have 6 months retention saved. 400(mb) x 180(days) = 72,000 = DB will need to be 72GB~. 

    • Once the DB is at the maximum capacity (72GB) it will automatically delete old files (older then 6 months as set) 
    • Deleting files manually by a user is NOT recommended. 
    • Note: Activity folder can grow up to 30% more then what you set as maximum DB size. There are 2 more types of data used by IOP: "Data Model" and "Acceleration files"
    • Then the total free space you should have on your disk is: 72 x 30% = 94GB

     

    The DataModels is also in the Settings tab and acts as a warm DB. Data in this DB is saved in order to retrieve it more quickly then older data. 

    DataModels.jpg

    By clicking on "Set acceleration period" you're able to choose how much you want your data models to hold back. 

    set.jpg

  • Converting Unix Time / Epoch Time to Real Time

    Unix time or Epoch time is the number of seconds since January 1, 1970. Some exported reports from Insights report time in this format.

    Excel doesn't contain built-in functions for working with Unix dates so they must be derived.
    Excel allows you to add a number of days to a date by using the "+" operator. Let's make use of that.


    First convert the number of seconds to number of days (by dividing by 60*60*24) and then add the result to the date "1/1/1970".


    The formula will look like

    =CELL/(60*60*24)+"1/1/1970"

    The quotes around the date are required. If they are not present, Excel will treat 1/1/1970 as an expression.

  • Top Windows Errors Report - Missing Data

    Top Windows errors report is a Monthly and very useful report which shows the most common Windows errors in your organization.

     In case you see gap in data or the report is empty, please check the following settings:

    1. Go in the Real Time Console to Settings -> Events Pane Settings

    2. Make sure the option "Collect Error Events" is checked

    2017-03-13_1007.png

    3. Go to Settings -> Triggers Settings

    4. Make sure both Errors in Application log and Errors in System log triggers are enabled

    2017-03-13_1007_001.png

    5. To verify the data is collected, you can go to the Incidents Pane and verify that Windows Errors incidents are being collected successfully.

    2017-03-13_1007_002.png

    Without those settings enabled, the report will be empty.

     

  • I do not have any application usage data in Insights

    The Issue:

    No data is presented in the application usage report. 

    The Reason:
    There is a cache data issue which prevents all filters to be presented, thus showing missing data.

    This is a known issue we are working on solving.

     The Solution:
     If you encounter this or similar issue, please follow these steps to fix it -

    1. In Chrome - click the F12 button
    2. Long click on the refresh button will give you "Empty cache and Hard Reload" option, please select it
    3. Log back to insights

  • I export data to excel but the times/dates come out wrong

    The Issue:

     

    You export data from Insights to CSV but the times are wrong:

     

     

    The Reason:

     

    Data is exported as RAW data to CSV files and excel displays it as RAW. 

     

    The Solution:

     

    Set the dates in your CSV file by right clicking the column and choosing Format Cells... and then using the Custom or Date category.

    Note: the times/dates are UTC, so make sure to change and add or subtract the hours according to your location.

     

     

    Format Cells - 

     

    The result - 

     

     

     

     

     

  • I see data in some reports but no data in other reports

    The Issue:

     

    "In my Insights view I get ZERO results for User Session Count but I do get data from User Session Activity."

     

    The Cause:

     

    ControlUp Insights supports only Chrome browser at the moment.

     

    The Solution:

     

    Please try to run ControlUp Insights in Chrome.

  • Cannot access Insights

    The Issue:
    You try to login to ControlUp Insights but fail.

    The Reason:
    Missing access privileges, password is not strong enough.

    The Solution:
     1. The only user in the organization who's allowed access to Insights is the user who created ControlUp organization. 

    The one created the ControlUp organization, can permit other users to login to Insights.

    2. To allow the access, go to "User Permissions" on the ControlUp Insights ribbon (this is basically a shortcut to Organization Properties).

    3. If the Security Policy was customized, you need the "Manage User Permissions to ControlUp Insights" permission to change those settings.

    4. By default, the additional security settings (MFA, email suffix restriction, source IP restriction) are not activated so they should not create issues. To check for possible mis-configurations, click the "Access Settings" button on the ControlUp Insights ribbon.

    5. Please also be aware that you will be asked to change the password if it's not strong enough for Insights (minimum of 8 characters). Once changed, the new password should also be used for console login.

    6. Check out the following YouTube clip which we created to assist customers.

  • Missing Data in Insights (Proxy Issue)

    The Issue:

    You see an error which describes an issue to upload data to S3 (insights server), you log in to ControlUp Insights but do not see any data.

     The Reason:

    You do not have access to ControlUp servers from the server where the ControlUp Monitor service is installed on. Because of that, no data is being uploaded.

    The Solution:
    Please allow access to the following servers via https:

    To test the connection to Insights data uploading server, open IE and browse successfully to https://uploads.controlup.com.s3.amazonaws.com, if you get the following screens it's working as expected:

     

     

    To test the connection to our configuration servers, open IE and browse successfully to https://fe1.controlup.com, if you get the following screens it's working as expected:

     

  • In some reports I see no data

    The issue:

    In some reports you see data as expected but in some you don't.

    The Reason:

    You are using Internet Explorer to access ControlUp Insights.

     

    The Solution:

    Please use Chrome and not IE, at the moment only Google Chrome is supported.

     

     

  • Published Application Usage details