Competitor Monitoring Overview

Midesk’s Competitive Monitoring capability is a powerful, AI-driven solution designed to help you gather and analyzing data from various online sources.

This page provides an overview of the key components involved in the competitive monitoring process and how different components interact with each other.

Key Components

Here’s a brief summary of each key component:

1. Monitoring targets: Automtaically scan a URL/API, monitor it, and spin up jobs based on the data found on the website, adapting jobs, tasks, and steps as needed.
2. Monitoring recipes: Define the behavior for each monitoring job, such as Scraper, Proxy Scraper, API job and more.
3. Monitoring jobs: Special scrapers for websites, social media, and APIs that extract data and notify users of significant changes.
4. Monitoring tasks: Data processing units within monitoring jobs. They are responsible for extracting data and notifying users of significant changes.
5. Processing steps: Specific sequence of extraction steps used to extract data within tasks. They are undeflined by a wide array of methods (GPT, xPath, JSON, and Regex) so you can extract the data you need.

Flowchart

To better understand the relationships between these components, refer to the flowchart below:

flowchart LR

  subgraph EXTERNAL[Web&API]
    direction LR
    class EXTERNAL cssClass
    URL[Url]
    SOCKY[Social media]
    API[API]
  end

  subgraph SYSTEM[Competititive Monitoring]
    direction TB
    subgraph TARGETS
        direction LR
        TARGET[Monitoring Target]
        IDENTIFIER[Identifier]

        TARGET --> IDENTIFIER
    end
    subgraph JOBS
        direction TB
        RECIPE[Monitoring recipe]
        JOB[Monitoring job]
        TASK[Monitoring tasks]
        STEP[Processing steps]

        RECIPE --> JOB
        JOB --> TASK
        TASK --> STEP
    end
  end

  subgraph WORKSPACE[ Your workspace ]
    direction LR
    DATA[Data]
    NEWS[News Articles]
    NOTIFICATIONS[Email notifications]
  end

  EXTERNAL <-- get --> SYSTEM
  SYSTEM -- save--> WORKSPACE
  TARGETS -- keeps up-to-date --> JOBS