Swash

<h3 id="with-scompute-swash-provides-a-way-for-data-scientists-to-perform-computations-on-the-data-without-needing-to-purchase-it-the-data-itself-remains-private-and-is-not-sold-or-moved">With sCompute, Swash provides a way for data scientists to perform computations on the data without needing to purchase it. The data itself remains private and is not sold or moved.</h3><p><img src="https://miro.medium.com/max/1400/1*egl4rviwpSBu7DJtAiyMLg.png" /></p><p><a href="https://medium.com/swashapp/introducing-scompute-web3-computational-power-for-developers-ea1079dad879" rel="noopener noreferrer nofollow">sCompute</a> allows <a href="https://swashapp.io/static/files/paper/whitepaper-v1-july-2021.pdf" rel="noopener noreferrer nofollow">sClients</a>, such as data scientists and sApps, to perform computations on raw Swash data on-premise and in a privacy-preserving manner. They do not need to purchase the data, instead they only pay fees related to the computation itself.</p><p>They can connect via the provided API or sPortal to deploy their algorithms. Computations can be fed by existing datasets or statistical data, or even the result of other computations. The results of the computation can then be stored as a dataset where it can be resold as adata product. The owner of the dataset and those whose data contributed to it will receive compensation when this is sold to data buyers. Computation results can also be made available only to the owner of the algorithm.</p><p>Despite the fact that created datasets have different identities for a user for different categories, in datasets created for computation, all identities of a user are mapped to a unique identity which correlates to all user data points collected through different collecting rules.</p><p>To preserve privacy, all algorithms should be audited manually before being used by the computation service to ensure that they are not trying to infer the identities of users and are aligned with Swash’s principles and standards for security. The Swash sCompute solution uses customised secure computation infrastructure to allow for trustless and autonomous interactions.</p><p><img src="https://miro.medium.com/max/1400/1*yN1bdnAo5VMrYYs43P1Nfw.png" /></p><h3 id="general-architecture">General architecture</h3><p>You can see an overview of sCompute general architecture below. This image shows how the main components of this system communicate with each other to conduct computation based on predefined sCompute requirements.</p><p><img src="https://miro.medium.com/max/1400/1*tEOdnGzoNvfjHBuuFF_9fw.png" /></p><p>In the following section, the structure of these components will be described in more detail and their responsibilities will be explained.</p><h2 id="header-0">Authentication layer</h2><p>Registration, authorisation, authentication and session management are the most important services of this layer.</p><h3 id="registration-flow">Registration flow</h3><p><img src="https://miro.medium.com/max/1400/1*SQXdAqZrE9QOVVnzy0NuRA.png" /></p><p>Registration operation uses an email verification approach that includes mailing a verification code to user to validate them. After this, the new user is added to the sCompute app.</p><h3 id="login-flow">Login flow</h3><p><img src="https://miro.medium.com/max/1182/1*bqW9jyqPowXf5C3jMZhInQ.png" /></p><p>In this flow, the user is verified and authorised based on their wallet address and using a related private key. At the end of this flow, a secure token containing their identity information is generated and used to manage session management requests.</p><h3 id="session-management">Session management</h3><p><img src="https://miro.medium.com/max/1112/1*C52CfYUMa32HppCdbMe_6w.png" /></p><p>For each API call or interaction, an access token is put in requests. The authentication layer then validates each request and updates user activity. Now, once validated, requests can be completed and their results are returned.</p><h3 id="stateless-interaction">Stateless interaction</h3><p>The client’s valid Ethereum wallet could also be used for authentication. It means that a client’s unregistered wallet address could be used for authentication and interaction purposes. However, the signature generation method mentioned in the login flow is completed for each interaction.</p><h2 id="header-1">Pipeline management layer</h2><p>This is the main component of sCompute. As previously mentioned, sCompute allows sClients, such as data scientists and sApps, to perform computations on raw Swash data. The pipeline management layer is responsible for providing this capability by controlling access to data and accounting. Let’s start by taking a look at the pipeline concept.</p><h3 id="swash-pipeline">Swash pipeline</h3><p>sPipeline is a work flow of computation. This concept consists of a series of interconnected steps that are defined as follows.</p><ul><li>Pre-processing</li><li>Training</li><li>Evaluation</li><li>Prediction</li></ul><p>The structure of a pipeline is determined by the data dependencies between steps. These data dependencies are created when the properties of a step’s output are passed as the input to another step.</p><p>In sCompute, the sPipeline is defined and ready to be used as a computation stack.</p><p><img src="https://miro.medium.com/max/1098/1*ehP8LfhpYQZP05zU2vkO7A.png" /></p><p>The pipeline management layer use access control and accounting modules to handle the pipeline flow.</p><h3 id="access-control-module">Access control module</h3><p>This module defines users’ activities based on their allocated resources. Running a pipeline requires some resources such as machines with CPU power for processing, and storage for saving results and log files. Therefore, the access control module communicates with the billing module and resource management layer to define user access based on dedicated resources to their own computation operation.</p><h3 id="accounting-module">Accounting module</h3><p>This module checks the user’s limitation and controls the user’s access based on these limitations. The accounting module should be able to answer a question about the current user:</p><ul><li>Did he pay for the required resources in current pipeline?</li></ul><h3 id="running-pipeline-flow">Running pipeline flow</h3><p><img src="https://miro.medium.com/max/1400/1*itXlpQMwkMGvfg8oa4lBDQ.jpeg" /></p><p>When a pipeline is requested, after the token validation in the authentication layer, the access control module checks the required resources for the pipeline in corporation with the accounting module.</p><p>Then the price of those required resources is calculated using the billing module and is based on resource evaluation of the resource management layer. If the payment is complete, the resources are allocated to the current pipeline and the execution can begin.</p><h2 id="header-2">Resource management layer</h2><p>As mentioned previously, dedicating resources to each pipeline and releasing them at the end is the most prominent responsibility of this layer. The resource management layer helps the pricing system to calculate the price of requested resources. Also, limiting usage and extending resources could be achievable via this layer.</p><h2 id="header-3">Limit control layer</h2><p>One of the biggest concerns in our system is controlling the output results. This layer helps us to apply some limitations over the output results. This layer is also responsible for filtering and sanitisation. For example, generating logs while the pipeline execution conducts other outputs. This layer controls the logs to prevent information leakage. Removing and replacing important information, such as IDs, paths, IPs etc, are included as part of this prevention action.</p><p>---</p><h3 id="about-swash">About Swash</h3><p>At Swash, if it’s your data, it’s your income.</p><p>Swash is an ecosystem of tools and services that enable people, businesses, and developers to unlock the latent value of data by pooling, securely sharing, and monetising its value.</p><ul><li>People share their data to earn while retaining their privacy.</li><li>Businesses access high-quality, zero-party data in a sustainable and compliant way.</li><li>Developers set up and build systems within a collaborative development framework with ease.</li></ul><p>As the world’s leading Data Union, Swash is reimagining data ownership by enabling all actors of the data economy to earn, access, build and collaborate in a liquid digital ecosystem for data.</p><p>Join the biggest data movement in Web 3:</p><p><a href="https://twitter.com/swashapp" rel="noopener noreferrer nofollow">Twitter</a> |<a href="https://t.me/swashapp_group" rel="noopener noreferrer nofollow"> Telegram</a> |<a href="https://www.reddit.com/r/Swash_App/" rel="noopener noreferrer nofollow"> Reddit</a> | <a href="https://discord.com/invite/p3DHbgHzdN" rel="noopener noreferrer nofollow">Discord</a> | <a href="https://www.instagram.com/swashapp.io/" rel="noopener noreferrer nofollow">Instagram</a> | <a href="https://www.tiktok.com/&#64;swashapp" rel="noopener noreferrer nofollow">Tiktok</a> | <a href="https://swashapp.io/" rel="noopener noreferrer nofollow">Website</a></p><p><em>Swash has completed a Data Protection Impact Assessment with the Information Commissioner’s Office in the UK and is an accredited member of the Data &amp; Marketing Association.</em></p>

sCompute Architecture

Table of Contents

Swash

Other articles published on Jan 11, 2023

Solana Pumps by More Than 35% Before Today’s Minor Correction

Wizarre December 2022 Summary

‘Best Time to Buy Bitcoin Is Now,’ Crypto Analysts, Experts Argue

20 Best Crypto Wallets in 2023: Why You Need One Now

Is a Bull Market on the Way in 2023? Here's What History Shows

ETH Forms Double Top, Prices Could Tank to $500: Crypto Analyst

Join our free newsletter for daily crypto updates!