Category: 1 SPL Understanding

SSC (Scudata SPL Cloud) Global Variable and Lock
Global variable In SSC environment, sometimes information needs to be shared between computing tasks (QVM scripts) on multiple QVMs. In this case, SSC global variable (simply written as global variable in the following part) is useful. Managed by QVS, the global variable is available to every script run on each QVM applied through QVS. Qenv function is used to assign value to the global variable: Qenv(“gv1”,1) #gv1 is the variable name Qenv(“gv1”) The function is also used to obtain the global variable: Qenv(“gv1”) Unlike an ordinary SPL global variable, related data will be transmitted between QVS and QVM once the

When will the pre calculation of customer profile analysis be over
Customer profiling is very fashionable in current business analysis. Simply put, it means putting various tags on customers, using these tags to define different customer groups (so-called profiles), and then calculating the quantity (and changes) of customers in each customer group. Logically speaking, tags are dimensions or fields of a data table. Tags are fields with relatively simple values, and there are generally two types: binary tags, which have only two values and are usually represented by 0/1, such as marital status or gender. Another type is enumeration tags, with values ranging from a few to a few hundred, which

After retrieving JSON from ES Kafka Mongodb Restful…
JSON is a good thing that can carry rich structured data information in a common text format. Many modern technologies prefer to use JSON as a data transmission format, such as Elastic Search, Restful, Kafka, etc. Mongodb, which is more concerned about performance, uses binary JSON. Structured data is often in bulk and often requires recalculation. However, JSON related class libraries are not very convenient to use for calculations. JSONpath is fine to parse JSON, but it doesn’t have much computing power. Simple filtering and aggregation are fine, but it cannot handle slightly complex operations such as grouping and summarization.

A major culprit in the slow running and collapse of a database
It is the very inconspicuous account de-duplication count, written in SQL as COUNT (DISTINCT…). Account de-duplication count is common and has important business significance in business analysis. The account here may be a user ID, bank account, phone number, license plate number…. The calculation logic is basically the same, which is to calculate how many accounts meet a certain condition from the historical data of a certain period of time. For example, how many cars have been to NewYork last month? How many phones had calls between 2:00 am and 4:00 am last week? How many bank accounts have received