New contribution records system (#3327584) · Issues · project / drupalorg

New contribution records system

>>> [!note] Migrated issue   Reported by: [fjgarlin](https://www.drupal.org/user/2495842) Related to !397 !395 !392 !388 !386 !384 !382 !378 !376 !375 !374 !373 !372 !371 !370 !365 !367 !366 !364 !351 !362 !361 !360 !355 !354 !353 !350 !336 !337 !332 !273 !147 >>> <h3 id="summary-problem-motivation">Problem/Motivation</h3> As a new system for contribution records is being built (see <a href="https://www.drupal.org/project/infrastructure/issues/3322116">https://www.drupal.org/project/infrastructure/issues/3322116</a>), we will need changes on D7 <a href="http://www.drupal.org">www.drupal.org</a> to adapt and communicate with it. The following tasks are part of the bigger plan detailed here: <a href="https://docs.google.com/spreadsheets/d/1UVM8Bs6VdoJFo2-DQGjTRo5yeecMWMvpRfgi8yhPQcQ/edit?pli=1#gid=1856250352">https://docs.google.com/spreadsheets/d/1UVM8Bs6VdoJFo2-DQGjTRo5yeecMWMvpRfgi8yhPQcQ/edit?pli=1#gid=1856250352</a> ✅ Migrate existing credits to the new system ✅ Provide links on issues to the new system related record ✅ Trigger webhook for comments to update contributors on new system ✅ Trigger webhook for issue status change to update the contribution record status on the new system ✅ Hide any form or reference to the old attribution system (comment form on issues) ✅ Change to user profiles to read from the new system ✅ Changes to organizations to read from the new system ✅ Changes to marketplace to read from the new system ✅ Improve UX to add individual contribution records and bulk credits I will use this issue/branch to put all the D7 changes that are required. <h3>Deployment</h3> ✅ First phase: Send data to new.drupal.org: - MR: <a href="https://git.drupalcode.org/project/drupalorg/-/merge_requests/337">https://git.drupalcode.org/project/drupalorg/-/merge_requests/337</a> - Settings on D7: -- Set <code>drupalorg_credit_migration_token</code> to the same value as the one set in D10 -- Set <code>contribution_records_base_url</code> to <code>https://new.drupal.org</code> -- Set <code>drupalorg_contribution_record_delay_microseconds</code> if we want to throttle requests to D10 -- Setup queue <code>drupalorg_issue_events</code> - Settings on D10: -- Allow 'contribution_records' in <code>drupalorg_allowed_content_types</code> -- Allow <code>/contribution-record*</code> paths on Fastly -- Allow <code>/drupalorg-api/*</code> paths on Fastly (I think this is done) -- Setup environment variable so this line works: <code>$config['drupalorg.settings']['credit_migration_token'] = getenv('DRUPALORG_CREDIT_MIGRATION_TOKEN');</code> -- Setup queue <code>contribution_records_import_queue_worker</code> <h4>✅ Send and process data from D7 to the new system</h4> * [D7 <a href="http://www.drupal.org]">www.drupal.org]</a>: <code>drush drupalorg-contribution-records-sync --raw-import=2</code> (when the queue runs, the record will be queued to be created in the new system, so the D7 push operation will be quick and should not timeout). * [D7 <a href="http://www.drupal.org]">www.drupal.org]</a>: <code>drush drupalorg-contribution-records-sync --node-type=sa --raw-import=2</code> - same but for SA. * [D7 <a href="http://www.drupal.org]">www.drupal.org]</a>: <code>drush queue-run drupalorg_issue_events</code> * [D10 new.drupal.org]: <code>drush queue:run contribution_records_import_queue_worker</code> <h4>✅ Data integrity checks</h4> Compare the data from the current system and the new system. See <a href="https://git.drupalcode.org/project/contribution_records/-/blob/1.0.x/scripts/check-records.sh?ref_type=heads">data integrity checks</a>. <h4>✅ Second phase: read credits from the new system</h4> - Merge MR351 / MR364 / more to come... - <code>drupalorg_credit_system</code> defaults to <code>legacy</code>, so everything will continue to be the same in D7 once merged. - Test new system (reading credits): -- <code>drush vset drupalorg_credit_system "modern"</code> -- <code>drush cc views</code> -- Visit user pages, org pages, owner tools pages, and re-run marketplace calculations - Revert to old system (D7): -- <code>drush vset drupalorg_credit_system "legacy"</code> -- <code>drush cc views</code> -- Visit user pages, org pages, owner tools pages, and re-run marketplace calculations <h4>✅ Last phase: write credits to the new system</h4> - D7 Make the new system the canonical source of credit information -- <code>drupalorg_credit_system</code> needs to be set to "modern" -- Then <code>drush vset drupalorg_credit_system_data_source "modern"</code> (or "legacy" to revert) - D10 -- Enable permission "edit any contribution_record content" for "authenticated users" -- Remove integrity checks cron job on prod. Add the following to `helm/drupalorg/prod/values.yaml` (watch indentation) in the "helm-deploy-tree" repo. <pre>migrationJobsStatus:     contributionRecords: false</pre>Steps: BEFORE - Communicate change and 20-30 min outage. - Set red banner top message with the information? DEPLOY - Merge last D7 changes: <a href="https://git.drupalcode.org/project/drupalorg/-/merge_requests/392/diffs">https://git.drupalcode.org/project/drupalorg/-/merge_requests/392/diffs</a> - Set D7 flag to "modern" - Run integrity checks one last time - Merge D10 changes: <a href="https://gitlab.com/drupal-infrastructure/sites/drupalorg/-/merge_requests/180/diffs">https://gitlab.com/drupal-infrastructure/sites/drupalorg/-/merge_requests/180/diffs</a> - <del>Merge helm-deploy-tree MR: <a href="https://gitlab.com/drupal-infrastructure/helm-deploy-tree/-/merge_requests/119/diffs">https://gitlab.com/drupal-infrastructure/helm-deploy-tree/-/merge_requests/119/diffs</a></del> AFTER - Clean all that work up (that can happen after) -- D7: Remove uneeded contributors block: <a href="https://git.drupalcode.org/project/drupalorg/-/merge_requests/397/diffs">https://git.drupalcode.org/project/drupalorg/-/merge_requests/397/diffs</a> -- ✅ D10: Remove temp message: <a href="https://git.drupalcode.org/project/contribution_records/-/merge_requests/15">https://git.drupalcode.org/project/contribution_records/-/merge_requests/15</a> + site update. -- 🚧 D10: Integrity check job in the module: <a href="https://git.drupalcode.org/project/contribution_records/-/merge_requests/16/diffs">https://git.drupalcode.org/project/contribution_records/-/merge_requests/16/diffs</a> -- D7: any code using "drupalorg_credit_system_data_source" if/else

issue