Skip to content

Arm backend: Add baseline functionality for zero copy IO project. - #23309

Open
wwwind wants to merge 5 commits into
pytorch:mainfrom
wwwind:zc_baseline
Open

wwwind wants to merge 5 commits into
pytorch:mainfrom
wwwind:zc_baseline

Conversation

@wwwind

@wwwind wwwind commented Oct 1, 2026 •

Copy link
Copy Markdown
Collaborator

Add baseline functionality for the VGF zero-copy I/O project.

This PR measures the current delegate-boundary copy cost before introducing host-memory import or descriptor rebinding. It records:

  • input/output copy bytes,
  • input/output memcpy time,
  • dispatch-and-wait time,
  • total VGF execute time.

The baseline uses 20 warmup iterations followed by 200 measured iterations in a single process.

Initial host-emulation measurements show:

  • MobileNetV2 FP32 224

    • input: 602,112 bytes
    • output: 4,000 bytes
    • input memcpy p50: ~0.014 ms
    • output memcpy p50: ~0.0004 ms
    • VGF execute p50: ~79.4 ms
  • RIFE

    • input copies: 22,118,400 bytes
    • output copy: 11,059,200 bytes
    • total boundary copy: 33,177,600 bytes / frame (~31.64 MiB)
    • memcpy p50: ~0.772 ms
    • memcpy p90: ~0.937 ms

These measurements were collected using the emulation layer and are not native Mali-device performance results.

No zero-copy behaviour is introduced by this PR.

The goal is to establish a reproducible baseline against which later zero-copy host-memory import changes can be compared.

cc @digantdesai @freddan80 @per @zingo @oscarandersson8218 @mansnils @Sebastian-Larsson @robell @rascani

Signed-off-by: Elena Zhelezina <elena.zhelezina@arm.com>
Change-Id: Id4f128df392625f71dabeacc21cff5a86d6b2b87
@wwwind wwwind added partner: arm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Arm ciflow/trunk release notes: arm Changes to the ARM backend delegate labels Oct 1, 2026
@wwwind wwwind added the module: arm Issues related to arm backend label Oct 1, 2026
@pytorch-bot

pytorch-bot Bot commented Oct 1, 2026 •

Copy link
Copy Markdown

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/23309

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 New Failures, 2 Pending

As of commit 306a22d with merge base fdd5140 (image):

NEW FAILURES - The following jobs have failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 1, 2026
@zingo

zingo commented Oct 1, 2026

Copy link
Copy Markdown
Contributor

I see some fails

The following tests FAILED:
53 - vgf_execution_stats_enabled_test (Not Run)
54 - vgf_execution_stats_disabled_test (Not Run)
Errors while running CTest

Was this added by your new macros maybe?

@wwwind

wwwind commented Oct 1, 2026

Copy link
Copy Markdown
Collaborator Author

let me take a look.

Signed-off-by: Elena Zhelezina <elena.zhelezina@arm.com>
Change-Id: I0160b3664b879bdcf579ffda799db523ade1043d

@zingo zingo left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ok to merge when CI finish and all is OK.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/trunk CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. module: arm Issues related to arm backend partner: arm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Arm release notes: arm Changes to the ARM backend delegate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants