[Blockdaemon] Update on the Infrastructure Proposal for Community Pool Funding

I really do apologize and your concerns are heard with the delay. I will share an update next week so that we can resolve.

Forgive me for being skeptical but these same promises have been made to me through email when I had to ask that we be given a public update(the only reason this thread exists) and the Terra community for months now. Its time for action, not a simple update. Release a beta version now and promise to supply us with this service for the next 2 years as retribution for months of service lost/delayed that harmed our ecosystem and prevented further growth or refund us. Its time for Blockdaemon to own its mistakes and start rebuilding trust with the community if Blockdaemon gives any care at all about Terra or its own reputation.

2 Likes

Next week? How is this acceptable? You had a self imposed deadline of May. It’s Nov. Now you can’t even give us an update for a week? That does not sound like concerns being heard. It is concerns being ignored.

With the most recent rollouts you can’t keep up? Instability & syncing?

Our extensive experience across protocols lets us expertly monitor, repair and replace nodes where protocol level errors may occur. For any protocol updates needed, we look after these in advance so you never see any disruption in service.

That is a quote from your website regarding the Terra blockchain. Terra - Blockdaemon: A Peer Reviewed Third Generation PoS Blockchain.

This is unacceptable.

Hey Everyone, We have been actively working on HA Terra load testing and making a lot of progress since the latest Terra update. We have been hitting the cluster hard to find the limitations. Below you will find our last result set of simulating 900 users over 30mins on Terra LCD endpoints.

Here are the highlights of the results:

  • We had a 99.47% success rate on being able to fulfill request made to the cluster and will continue to work to improve this number!
  • During our testing 95th percentile of our test took around 6 seconds to complete. The majority of the calls did not use static dat during testing.
  • We were able to make a total of 698252 total request in 30 mins which gave us an average of 381.557047 request per second
  • We will be disabling tendermint rpc due to the known oom issues, and will re-enable it once those are fixed ([BUG] memory fragmentation · Issue #592 · terra-money/core · GitHub and [BUG] Memory usage increases extremely fast · Issue #585 · terra-money/core · GitHub )
  • We will have the endpoint available to the community Nov 15. if we feel comfortable with it earlier, we will absolutely post it earlier!
  • We are also in discussions for ways we will be giving back to the community so will share the plan here too.

1 Like

Thank you so much for hearing us and posting this update. It is good to know that things are progressing and we look forward to hearing your plans and for Nov 15th!

1 Like

Hello Katie -

It is Nov 15th and we in the community are very excited to hear that you have an endpoint ready for the community to use! Please feel free to share the great news.

Excited to see what you have for us

Hi Terra Community,

Our Terra Cluster endpoint is now available! You can access it here and try it out:

Endpoint: https://blockdaemon-terra-lcd.api.bdnodes.net:1317

  • LCD endpoints only! Swagger UI
  • Performance highlights:
    • Improved test cases to mimic actual user actions
    • 3924 request made over 5 minutes
    • max 100 concurrent users
    • we had a 92.02% success rate on being able to fulfill request made to the cluster
      • This factors in timeouts and when nodes need to be rotated out when they stop syncing (known issue with LCD)
    • Request per second 11.890737/s
    • Request duration of 1 minute on average when looking up randomized valid data (e.g. block height, validator sets at blocks, account information, account balances, validator information, delegations for randomized validators, outstanding rewards/commission/slashes for random validator endpoints, …)

Due to the documented mem issues the network is experiencing, we’ve chosen to disable the tendermint RPC until the issues are improved or resolved.

In addition, we will have more news later this week on the bounties going up on gitcoin for

  • Adding additional to the Memory Fragmentation bounty
  • Sync issue when calling LCD endpoints
  • Network performance related to increasing validators

We will be continuously testing and looking to improve the cluster, so the community has the best and improved experience, as some of these issues are resolved.

Stay tuned for more details and further updates over the next few weeks/months. If you have feedback, please reach out to us at [email protected] so that we can answer your questions quickly!

5 Likes

I am relived to see real results, thank you for producing as requested. I look forward to hearing further details from Blockdaemon as there are many specifics of the original deal that remain unresolved or unaddressed.

2 Likes

Hi Katie, do you have any updates on the following? Its been well over a week:

Thank you!

Hello @Katie_DiMento,

Can we please be given an update? Or does the community really need to take to twitter again to get your attention?

Thank you.

Hi @somethingelse,

Apologize for the delay and know that we are on it. We’re wrapping up milestone one (part 2) this week, in having the cluster provided previously available through our Ubiquity app - with the addition of our standard API integration for common calls.

The access will still be available free of charge to the community for the next year.

Following soon after in February will be streaming, through the Ubiquity platform.

Will post again later this week when Terra option is in the app for you to play with!

2 Likes

Not gonna lie, I can’t help but feel there should have been a bit more urgency here. This isn’t to throw shade as we’re big fans of BlockDaemon (I have personally hung out with Konstantine a few times over the years, lovely guy) but to share realistic feedback from the trenches.

For us at Bidali, because this has been “coming” for almost a year now, in November last year we decided to pull the trigger and just run our own node. We got a fully synced RPC node up and running with websocket streaming behind our load balancers and integrated into our own blockchain agnostic API in weeks.

I know there are competing priorities and it takes additional work to make this scalable for others to consume reliably, but had we been granted a $100k in LUNA grant (worth ~$1.5M at today’s prices, assuming 25k LUNA) this would have been publicly consumable within months and made a major priority.

We’re now going on almost a year and we’re still unable to use BlockDaemon for Terra (and many other networks because of the lack of streaming support). Even QuikNode added it recently and AFAIK they didn’t receive any grants.

Don’t get me wrong, I’m glad to finally see a meaningful progress update, but I can’t help but feel as if proper Terra support has taken a back seat to other priorities. :disappointed:

1 Like

Hi Terra Community!

We have some great news - all of the deliverables on our infrastructure proposal are complete.

Here the deliverables as follows:

Relaunch of the Terra Validator -DONE - launched in May ’21 and can be viewed here: Terra Finder

Grant Milestone 1 - Transactions & Balances and RPC Endpoints -DONE:

Part 1: RPC Endpoints

  • Endpoint delivered Nov ’21

Can access it here and try it out:

Performance highlights:

  • Improved test cases to mimic actual user actions
  • 3924 request made over 5 minutes
  • max 100 concurrent users
  • we had a 92.02% success rate on being able to fulfill request made to the cluster
    • This factors in timeouts and when nodes need to be rotated out when they stop syncing (known issue with LCD)
  • Request per second 11.890737/s
  • Request duration of 1 minute on average when looking up randomized valid data (e.g. block height, validator sets at blocks, account information, account balances, validator information, delegations for randomized validators, outstanding rewards/commission/slashes for random validator endpoints)

Part 2: Ubiquity integration complete, available in the blockdaemon app - DONE - Jan ‘22

Grant Milestone 2 - Streaming - DONE - Jan ’22

  • Part of the Ubiquity feature set

We do understand the delays and because we did not deliver in the timeframe that was originally discussed, we are giving back ALL of the tokens received at their current price to the community pool. We wanted to deliver on these milestones because we are committed to the Terra community and know the importance of the projects that need the above milestones. By delivering the tokens back, more projects can utilize funds to continue to progress the overall ecosystem!

4 Likes

Hi Katie,

What a journey it has been. I’ll be the first to say that I had doubted Blockdaemon’s commitment to fulfilling its promise to Terra. However, this post puts all doubts to rest, you did the right thing and I truly appreciate that. Bravo! Thank you again and I hope to see more from Blockdaemon in the future!

2 Likes

Kudos for delivering and returning the tokens. Appreciate you addressing the doubts, and supporting the community fund.

1 Like

I went to the RPC endpoint and got this: “not implemented”

https://blockdaemon-terra-lcd.api.bdnodes.net:1317

Hi @Kyu - could you let me know what request it was so we can troubleshoot?

Hi Kyu,

I didn’t hear back but wanted to show more guidance on how to use and examples that you can do as this cluster is available for anyone to use. There is no need to have the end user have an auth token, the user will just need to use the URL plus port(s) to use the correct endpoints on the cluster. Here are some examples of how you can use the end points:

Base URL:

https://blockdaemon-terra-lcd.api.bdnodes.net/

Tendermint Endpoints

URL for Tendermint endpoints:

https://blockdaemon-terra-lcd.api.bdnodes.net:26657

To see a list of endpoints that are supported in our cluster the user will need to visit the following URL: https://blockdaemon-terra-lcd.api.bdnodes.net:26657/

Note that not all official endpoints are supported on our cluster so if you do not see it in the above output, please reach out to us and we can look into it and let you know how we can assist.

If you need information on the endpoints you can look at the official docs found here: Tendermint RPC

Example of how to use the endpoints:

Get Block info
REST API (works on browsers)
https://blockdaemon-terra-lcd.api.bdnodes.net:26657/block?height=6311484
RPC equivalent (does not work on browser)

For reference above: curl -X POST ‘https://blockdaemon-terra-lcd.api.bdnodes.net:26657’ --header ‘Content-Type: application/json’ --data-raw ‘{“jsonrpc”: “2.0”,“method”: “block”, “params”: [“6311484”], “id”: 1}’

Number of unconfirmed Transaction
REST API (works on browsers)
https://blockdaemon-terra-lcd.api.bdnodes.net:26657/num_unconfirmed_txs
RPC equivalent (does not work on browser)

For reference above: curl -X POST ‘https://blockdaemon-terra-lcd.api.bdnodes.net:26657’ --header ‘Content-Type: application/json’ --data-raw ‘{“jsonrpc”: “2.0”,“metod”: “num_unconfirmed_txs”, “params”: [], “id”: 1}’

Check validators at specific height
REST API (works on browsers)
https://blockdaemon-terra-lcd.api.bdnodes.net:26657/validators?height=6311484
RPC equivalent (does not work on browser) - for this RPC example you will need to pass all parameters into your call

For reference above: curl -X POST ‘https://blockdaemon-terra-lcd.api.bdnodes.net:26657’ --header ‘X-Auth-Token;’ --header ‘Content-Type: application/json’ --data-rw ‘{“jsonrpc”: “2.0”,“method”: “validators”, “params”: [“6311484”,“1”,“30”], “id”: 1}’

LCD Endpoints

URL for LCD Rest Endpoints

https://blockdaemon-terra-lcd.api.bdnodes.net:1317

There is no endpoint that gives you the list of supported endpoints for LCD but the official documentation can be found here: Swagger UI

Example on how to use endpoints:

Get Node info using Terra Rest
REST API (works on browser)
https://blockdaemon-terra-lcd.api.bdnodes.net:1317/node_info
There is no RPC equivalent

Get block height info using Tendermint Rest
REST API (Works on browser)
https://blockdaemon-terra-lcd.api.bdnodes.net:1317/blocks/6311484
There is no RPC equivalent
Query to view validator info, Blockdaemon is used an example

REST API (works on browser)
https://blockdaemon-terra-lcd.api.bdnodes.net:1317/cosmos/staking/v1beta1/validators/terravaloper155x8vngnz4u2ce3fs6dvu027v8w90jqdjtdp3h
There is no RPC equivalent

Query the exchange rate of a denomination, denomination UUSD used in this example
REST API (works on browser)
https://blockdaemon-terra-lcd.api.bdnodes.net:1317/terra/oracle/v1beta1/denoms/uusd/exchange_rate
There is no RPC equivalent

I hope this helps and please again reach out for any questions!

2 Likes