TL;DR<a href="https://nodereal.io/" rel="noopener noreferrer nofollow">NodeReal</a> is writing a series about the performance of BNB Smart Chain and what it has done to keep improving its performance by reducing the block processing time.For your convenience, the previous article links have been provided below:<ul><li><a href="https://nodereal.io/blog/en/bnb-smart-chain-performance-anatomy-series-chapter-i-the-critical-3-seconds/" rel="noopener noreferrer nofollow">Chapter I: The Critical 3 Seconds</a></li><li><a href="https://nodereal.io/blog/en/bnb-smart-chain-performance-anatomy-series-chapter-ii-99-cache-hit-rate/" rel="noopener noreferrer nofollow">Chapter II: the 99% Cache Hit Rate</a></li><li><a href="https://nodereal.io/blog/en/bnb-smart-chain-performance-anatomy-series-chapter-iii-smooth-validation/" rel="noopener noreferrer nofollow">Chapter III: Smooth Validation</a></li></ul>In this post (Chapter IV), we will talk about pipeline, a high-frequency vocabulary in concurrency architecture design.In a nutshell, pipeline is a mechanism to divide a process into several stages, different stages can be processed concurrently in an organized way. Pipeline can be quite complicated, as it needs to guarantee an efficient performance improvement and also satisfy some sequential dependencies of the whole process.<img src="https://academy-public.coinmarketcap.com/optimized-uploads/69b30f623c754509b971a58e7c1b4969.png" /><h2 id="header-0">The Block Process Stages</h2>As we have introduced the stages of the block process in the first post - <a href="https://nodereal.io/blog/en/bnb-smart-chain-performance-anatomy-series-chapter-i-the-critical-3-seconds/" rel="noopener noreferrer nofollow">Chapter I: The Critical 3 Seconds</a>, let’s take a brief retrospect on the whole process.<img src="https://academy-public.coinmarketcap.com/optimized-uploads/7e16fd57dcab42d8874445ba41e3630b.png" />Within the 3 seconds period, each validator mainly needs to accomplish 2 tasks:<ul><li>Block Import Task: to download and verify the block produced by the previous validator</li><li>Block Mine Task: to generate its own block and broadcast it to other validator peers</li></ul>Although the general procedure for import and mine tasks are similar: download -&gt; execution -&gt; validation -&gt; commit, they have some differences which make the pipeline approach a bit different.<h2 id="header-1">Block Import</h2>The main purpose of block import can be summarized as:<ul><li>WorldState Update: the blockchain is a linear world state change history, one block followed by another。 Each block could update the shared world state and the following block relies on the previous block’s process results</li><li>Block Verification: to verify the block hash, the signature of the transaction sender, the MPT root. Only valid blocks will be accepted and inserted into the blockchain</li></ul>Before a block can be processed, an accurate world state is a must, but the verification result is optional, which means the world state update is essential while verification can be optional.<h2 id="header-2">Block Mine</h2>While for block mine task, it has 2 main purposes as well:<ul><li>WorldState Update: the same as block import</li><li>Generate Verification: to produce a block, the validator not only needs to wrap the transactions into a block, but also add proofs, especially the MPT root proof</li></ul>Before a block can be broadcasted to other peers, the block producer must attach the corresponding proofs, which means both world state update and verification generation are essential.How Did NodeReal HelpAs we have explained some rationales of the block process procedure,  next let us introduce you our approaches to the pipelined block process at NodeReal.What we have done are mainly included in the following patches. If you are an engineer, you could just review these patches and get a deeper understanding of its inner implementation.<ul><li><a href="https://github.com/bnb-chain/bsc/pull/668" rel="noopener noreferrer nofollow">https://github.com/bnb-chain/bsc/pull/668</a></li><li><a href="https://github.com/bnb-chain/bsc/pull/795" rel="noopener noreferrer nofollow">https://github.com/bnb-chain/bsc/pull/795</a></li><li><a href="https://github.com/bnb-chain/bsc/pull/975" rel="noopener noreferrer nofollow">https://github.com/bnb-chain/bsc/pull/975</a></li><li><a href="https://github.com/bnb-chain/bsc/pull/992" rel="noopener noreferrer nofollow">https://github.com/bnb-chain/bsc/pull/992</a></li></ul><h2 id="header-3">Rational</h2>The state verification &amp; Snapshot/MPT commit takes a lot of time.  While in most cases, the verification can pass, there is no need to wait for the verification result sequentially.For snapshot/MPT commit, we only persist the bottom diff layer to disk, there is no need to wait for it to finish. NodeReal  proposed an asynchronous state verification and asynchronous snapshot/MPT commit solution.<img src="https://academy-public.coinmarketcap.com/optimized-uploads/4ca928e2fd0b422dab4ab88480afe014.png" /><h2 id="header-4">State Verification Pipeline</h2>Once Block Process and Snapshot Commit are done, there is no need to wait for State Verification, the blockchain can process the next block. For the next block, before it starts State Verification, it has to wait until the State Verification of its parent finishes.<h2 id="header-5">Commit Pipeline</h2>Both MPT and Snapshot need to be persisted into storage, the storage can be Memory DB and Disk DB, NodeReal introduced the asynchronous persistence of Disk DB without breaking the processing of the following blocks.What Are The BenefitsWith the pipelined state verification and commit enabled, the cost of the two stages has reduced tremendously.The numbers say it all. Take a look at the comparison test we had done. The following image shows that the cost of state verification has been reduced by ~30% -&gt; ~70% and the cost of block commit has even been reduced by ~90%.<img src="https://academy-public.coinmarketcap.com/optimized-uploads/38dbbb8472bd44299880c05493c3ea3b.png" /><img src="https://academy-public.coinmarketcap.com/optimized-uploads/6a6bf61acc62453195ef183b9ce9a2d0.png" />ConclusionThe pipeline feature was delivered in <a href="https://github.com/bnb-chain/bsc/releases/tag/v1.1.9" rel="noopener noreferrer nofollow">v1.1.9</a> on Apr 12 2022, it can improve the performance a lot by saving most of the MerkleRoot calculation cause.The feature can easily be turned on by adding an option: “--pipecommit”  to the start command line, just have a try with the latest release  if you are interested.As one of the core contributors to BNB Chain, NodeReal is in full support of it by not only contributing to the core tech development, and also providing <a href="https://nodereal.io/bnb-chain" rel="noopener noreferrer nofollow">a one-stop infrastructure for the BNB Chain builders</a> as shown below. Learn more about it <a href="https://nodereal.io/bnb-chain" rel="noopener noreferrer nofollow">here</a> and let NodeReal make your Web3 REAL<img src="https://academy-public.coinmarketcap.com/optimized-uploads/a47d1b21d11540bfb6ad43f9736e0485.png" /><h3 id="strong-about-nodereal-strong">About NodeReal</h3><a href="https://nodereal.io/" rel="noopener noreferrer nofollow">NodeReal</a> is a one-stop blockchain infrastructure and service provider that embraces the high-speed blockchain era and empowers developers by “Make your Web3 Real”. We provide scalable, reliable, and efficient blockchain solutions for everyone, aiming to support the adoption, growth, and long-term success of the Web3 ecosystem.<h3 id="strong-join-the-nodereal-community-strong">Join the NodeReal Community</h3>Join our community to learn more about NodeReal and stay up to date!<a href="https://t.co/ilHSgmYIPT" rel="noopener noreferrer nofollow">Discord</a> | <a href="https://twitter.com/Nodereal_io" rel="noopener noreferrer nofollow">Twitter</a>| <a href="https://t.co/dUfX8RdcCa" rel="noopener noreferrer nofollow">Youtube</a> | <a href="https://www.linkedin.com/company/nodereal/" rel="noopener noreferrer nofollow">LinkedIn</a><h3 id="follow-us-to-stay-updated-on-everything-bnb-chain">Follow us to stay updated on everything BNB Chain!</h3><a href="https://www.binance.org/en/smartChain" rel="noopener noreferrer nofollow">Website</a> | <a href="https://twitter.com/BNBCHAIN" rel="noopener noreferrer nofollow">Twitter</a> | <a href="https://twitter.com/BNBChainDevs" rel="noopener noreferrer nofollow">Twitter (Devs)</a> | <a href="https://t.me/BinanceDEXchange" rel="noopener noreferrer nofollow">Telegram</a> | <a href="https://www.youtube.com/c/BinanceSmartChainOfficial/featured" rel="noopener noreferrer nofollow">Youtube</a> | <a href="https://gitcoin.co/binance-chain" rel="noopener noreferrer nofollow">Gitcoin</a> | <a href="https://discord.com/invite/binancesmartchain" rel="noopener noreferrer nofollow">Discord</a> | <a href="https://www.buildnbuild.dev/" rel="noopener noreferrer nofollow">Build N&#39; Build Forum</a>

BNB Smart Chain Performance Anatomy Series - Chapter IV: Block Process In Pipeline

Table of Contents

BNB Chain

Other articles published on Nov 21, 2022

Binance CEO CZ Compares FTX Debacle to 2008 Financial Crisis

The CEO of Binance clarifies reports of an API leak

PVP is live. The World Cup Tournament Qualifiers

Exchange Withdrawals Hit ATHs As Bitcoin Investors Opted Self Custody

Why we decided to choose Algorand ?

WOOFi launches exclusive competition for BAB token holders

Join our free newsletter for daily crypto updates!