Architecture
Standard Architecture
The Lobster_data server component runs as an application on the Lobster Integration Server. The Integration Server additionally contains a variety of different communication services (e. g. the HTTP service, JDBC service (database), etc.), which are accessed by Lobster_data.
The client component of Lobster_data (simple browser) can be run concurrently on several workstation computers of the users and communicates with the server component via TCP/IP.
As a basis for each Lobster_data installation, you must have a Java Development Kit (JDK) and a database installed.
Standard License
The purchase of a Lobster_data license typically entitles you to install two systems.
A productive system for the productive processes, if necessary in a highly available environment.
A test system for the development of new profiles. The test system has some limitations that make it unsuitable for productive use (the retention time of backups and logs is limited to 5 days, for example).
For details of our licensing models, in particular prices, please contact our sales representatives.
Remote Server
Remote servers can be used to process ETL/ELT jobs there to increase performance . Note: The add-on module ETL/ELT is currently only available as a beta version.
DMZ Server
A demilitarised zone (DMZ) is a special network section that is placed between Internet and Intranet for security reasons. Lobster offers a DMZ server for increased security when exchanging data with business partners. The following screenshot shows one of the possible architectures.
Load Balancing
Lobster_data offers the possibility to build a load balancing system. A load balancing system consists of at least one Lobster_data node controller and one Lobster_data node, but the number of Lobster_data nodes is scalable upwards. The Lobster_data Node Controller accepts the data input of all input sources and distributes the conversion tasks to the active Lobster_data nodes. Thus, the load to be processed can be divided. If the load is permanently too high in the overall system, another node can be integrated into the system for more processing power.
Additional Modules
Additional (licensed) modules are available for Lobster_data for more specific/extended requirements. For further details, please contact our sales representatives. The following is a list of additional modules that modify/expand the standard architecture of the installation or the data processing logic.
Content Inspection
With the add-on module Content Inspector Manager, files can be collected and split or merged. The files to be processed must be explicitly delivered to the Content Inspector Manager before they are inspected. There will be no inspection in the normal Lobster_data file input, as the name might suggest. The regular file input in Lobster_data is not affected by the Content Inspector Manager. At a defined time, the collected (and possibly split or merged) files are then sent by email, for example, or forwarded for further processing (to a profile or the ASM module).
Asynchronous Sending Module (ASM)
The additional module ASM (Asynchronous Sending Module) is used to transfer any number of files to a communication partner in just one session. That is, ASM collects files and transmits them at a defined time. Optionally, these files can be packed in archive containers (ZIP, TAR, ...) before they are transferred.
Managed File Transfer (MFT)
The additional module MFT is used to build up a client-server structure. The additional module can act as a client or as a server in an installation of the Lobster Integration Server. The MFT system consists of a central server and one or more clients. The purpose of the system is the automated uploading of files from the clients to the central server. This takes place in a defined temporal interval.
DataCockpit
The add-on module DataCockpit provides a simple way to monitor processes in Lobster_data through normal browser access. In addition, each user can be assigned individual rights and views. This is useful for giving supervisors and external users limited access. In addition, form profiles and workflows are available here .
Workflows
Many of you will already have experience in dealing with profiles and will appreciate the advantages of this simple form of data processing. However, these days more and more business areas are being incorporated into the digital sphere. On the one hand, of course, this is an advantage because it offers opportunities to increase efficiency. On the other hand, it also increases the complexity of the processes that you have to model digitally. To accompany you on this path and make it as simple as usual, Lobster_data now offers a further abstraction level of data processing with the add-on module Workflow. With this module you can graphically model complex digital processes (without necessarily knowing technical details) and then fill them with technical life. These two steps can be performed by different people, providing a communication tool between your business departments and IT. This allows you to make existing processes clearer, but of course also to design new processes in a simple way, whereby you can easily integrate already existing and proven profiles, for example, but also more.
Cold Standby
There are several ways to set up a cold standby system as a backup for Lobster_data or a DMZ server.
The easiest way is to run the entire installation, including the required database and the backup directory, on the local computer. In this case, the installation directory and the backup directory must be regularly copied to the cold standby computer.
For more details and further variants, see Concepts for Cold Standby.