Making WordPress.org

Opened 3 years ago

Last modified 3 months ago

#6087 new feature request

Provide a GitHub Integration for Plugins

Reported by: dd32's profile dd32 Owned by:
Milestone: Priority: high
Component: Plugin Directory Keywords:
Cc:

Description (last modified by SergeyBiryukov)

Many developers use GitHub to develop their plugins, and only use SVN as a deployment destination.

In order to "modernise" the plugin developer experience, being able to document a GitHub workflow along side the SVN flow, that doesn't require a user to share their WordPress.org password with GitHub or another 3rd-party service would be beneficial.

There's an existing GitHub Action which simply commits to SVN, https://github.com/10up/action-wordpress-plugin-deploy but that requires storing the committers password on GitHub, which not all are comfortable doing.

I'm not sure how this would be best implemented, there's multiple options:

  • Sync a plugin release on GitHub to plugins.svn automatically
  • Treat the GitHub location as the primary source, and pull directly from there with no plugins.svn integration
  • Provide a GitHub action that worked with a token and and API from #6086 to upload a release ZIP

Then there's also how to implement it:

  • Manual GitHub Action configuration required by the plugin author
  • GitHub App to install to the Repo, oAuth's against GitHub and W.org to authorize itself, and takes care of spawning actions as needed
  • GitHub App that installs the GitHub action, sets the token, and then doesn't do anything further.

I'm marking this as low priority as there exists an existing GHA for this that works, and there's likely other steps that would need to be done first to allow it (ie. Ability to oAuth against the dotorg account, or for an API to upload via to exist, etc).

Change History (10)

#1 @dd32
3 years ago

See Also: #3880 #3937

#2 follow-up: @seebeen
3 years ago

GitHub App to install to the Repo, oAuth's against GitHub and W.org to authorize itself, and takes care of spawning actions as needed

As someone who releases composer modules to packagist.org, a flow similar to theirs would be awesome.
WP.org could either pull the release asset (zip file) or use gitattributes to sync up to github.

#3 follow-up: @JeffPaul
3 years ago

but that requires storing the committers password on GitHub, which not all are comfortable doing.

(note I added the emphasis above)

The password is stored as a GitHub secret and can be done at an org-level and maintained there and not within individual repos (for folks who maintain multiple plugins within a single org). From GitHub's emphasis on their secrets:

Encrypted secrets allow you to store sensitive information in your organization, repository, or repository environments.

So I'm really not sure that there is a worthwhile solution that won't take a significant amount of time to craft that would be more secure than the current approach. I won't argue that a different approach would be more graceful or seamless an integration, but speaking as someone currently supporting the GitHub Action of note I'm happy to keep triaging and supporting folks using it to keep GitHub and SVN working in tandem (barring overly complex GitHub setups).

#4 @SergeyBiryukov
3 years ago

  • Description modified (diff)

#5 in reply to: ↑ 2 @dd32
3 years ago

Replying to seebeen:

As someone who releases composer modules to packagist.org, a flow similar to theirs would be awesome.
WP.org could either pull the release asset (zip file) or use gitattributes to sync up to github.

As someone who doesn't release composer modules, would my assumption that it simply polls Github for new Releases and pulls the Release / Revision / etc from there be correct?

#6 in reply to: ↑ 3 @dd32
3 years ago

Replying to JeffPaul:

but that requires storing the committers password on GitHub, which not all are comfortable doing.

(note I added the emphasis above)

The password is stored as a GitHub secret and can be done at an org-level and maintained there and not within individual repos (for folks who maintain multiple plugins within a single org).

To be clear - If someone wanted to do that, that's fine, but WordPress.org can't really say "Share your password with a 3rd party company".. nor can we just expect everyone to be comfortable doing that. It also makes things more complicated for those who change passwords often or use a Password manager.

It would be better if an Application Password could be used at least, so that the auth token is specific to it's use-case and can be revoked or not allowed to be used for login.. but our auth extension for SVN is not exactly super flexible, and I'm hesitant to be the one to write the extensions to it needed and end up as the forever maintainer..

There's been cases in the past where PRs against a Github repo have been used to leak Secrets (although these could be seen as mis-configurations) this covers some aspects and even suggests storing scoped tokens: https://docs.github.com/en/actions/security-guides/security-hardening-for-github-actions

I recognise that the existing GHA has had significant investment from 10up in support, development, and ongoing maintenance, but having a native option would be beneficial for all plugin developers and even reviewers.

#7 @JeffPaul
3 years ago

Totally agree that a native option (especially a straightforward one to setup/maintain per plugin) would be most beneficial. I'd be curious to understand how that would work, as I'd love a more graceful flow.

#8 @dd32
3 years ago

  • Type changed from enhancement to feature request

#9 @seebeen
9 months ago

A lot of time has passed since my last comment here, and I've learned a lot in the meantime.

Before I dive in - keep in mind that I speak as:

  • A WordPress developer who regularly publishes to both wp.org and our own private WP repo.
  • A PHP developer who developed a composer module for easy updates from private repositories (link)
  • A semantic-release/wordpress maintainer.

As someone who doesn't release composer modules, would my assumption that it simply polls Github for new Releases and pulls the Release / Revision / etc from there be correct?

@dd32

Yes, but packagist / composer is an entirely different ballgame than WP plugins. Composer packages are published as is. And you download them straight from github tag. No build process, etc. Everything happens on the developer's or a CI machine. That's why vendor directory is not pushed to github, but is in a release tarball / zip.

Github secrets are a reliable way of keeping, well, secrets - and they are secure. There is leakage potential, but GitHub does a pretty good job of detecting and notifying you about those possibilities. So an individual needs to be really stubborn and ignore all warnings in order to leak them.

Having a native option would be very hard and very resource intensive for everyone on wp.org side, because most of the plugins need to fetch composer packages, run tests, build assets. It's all done on CI.

Only possibility I can see so far, is to get the release zip files directly from github releases and then unzip them directly to SVN.

If you think that route is doable - we can work together so I can develop the semantic-release plugin with that in mind - because it already builds a zip file with attached readme and assets.

On my end, I'm gonna implement the entire push to SVN from the plugin in the coming months so devs who work on github can have a unified solutioin for release / deployment to .org (and private repos).

Looking forward on hearing your input 😊

#10 @dd32
3 months ago

  • Priority changed from low to high
Note: See TracTickets for help on using tickets.