hyperlane-monorepo

The home for Hyperlane core contracts, sdk packages, and other infrastructure

blockchain hyperlane interchain monorepo

History

Asa Oines 63562c7211 Refactor agent event indexing (#2246 ) ### Description This PR refactors event indexing in the agents, allowing similar logic to be shared across multiple event types (i.e. messages, deliveries, gas payments) and database types (i.e. the Relayer rocks DB and Scraper SQL DB). Furthermore, it adds new syncing modes by way of `MessageSyncCursors` that take advantage of the monotonically increasing dispatched message nonce to sync more intelligently. ### Drive-by changes - Fixes a bug in the existing cursor that caused the same block range to be indexed three times - Modifies kathy to get rid of the idea of "rounds", just sends messages with a sleep in between - Minor modifications to the e2e test for performance - Expand macros in settings - Add scraper to e2e test ### Opportunities for improvement - We can further reduce RPC usage (or improve latency) by sharing the view of the latest finalized block number between cursors - We can speed up the effective time for (a relayer to start deliving messages \| the scraper to scraper recent events) by creating forward/backward cursors for gas payments and deliveries where the backwards cursor terminates at index_settings.from - We can remove the need for index_settings.from by terminating backwards cursors based on the block number that the first message was dispatched at ### Related issues - Fixes #[issue number here] ### Backward compatibility _Are these changes backward compatible?_ Yes _Are there any infrastructure implications, e.g. changes that would prohibit deploying older commits using this infra tooling?_ None ### Testing _What kind of testing have these changes undergone?_ E2E tests --------- Co-authored-by: Mattie Conover <git@mconover.dev>	2 years ago
..
hyperlane-ethereum	Refactor agent event indexing (#2246 )	2 years ago
hyperlane-fuel	Refactor agent event indexing (#2246 )	2 years ago

### Description

This PR refactors event indexing in the agents, allowing similar logic
to be shared across multiple event types (i.e. messages, deliveries, gas
payments) and database types (i.e. the Relayer rocks DB and Scraper SQL
DB).

Furthermore, it adds new syncing modes by way of `MessageSyncCursors`
that take advantage of the monotonically increasing dispatched message
nonce to sync more intelligently.

### Drive-by changes

- Fixes a bug in the existing cursor that caused the same block range to
be indexed three times
- Modifies kathy to get rid of the idea of "rounds", just sends messages
with a sleep in between
- Minor modifications to the e2e test for performance
- Expand macros in settings
- Add scraper to e2e test

### Opportunities for improvement

- We can further reduce RPC usage (or improve latency) by sharing the
view of the latest finalized block number between cursors
- We can speed up the effective time for (a relayer to start deliving
messages | the scraper to scraper recent events) by creating
forward/backward cursors for gas payments and deliveries where the
backwards cursor terminates at index_settings.from
- We can remove the need for index_settings.from by terminating
backwards cursors based on the block number that the first message was
dispatched at

### Related issues

- Fixes #[issue number here]

### Backward compatibility

_Are these changes backward compatible?_

Yes

_Are there any infrastructure implications, e.g. changes that would
prohibit deploying older commits using this infra tooling?_

None


### Testing

_What kind of testing have these changes undergone?_

E2E tests

---------

Co-authored-by: Mattie Conover <git@mconover.dev>

2 years ago

hyperlane-ethereum

Refactor agent event indexing (#2246 )

2 years ago

hyperlane-fuel

Refactor agent event indexing (#2246 )

2 years ago