Skip to content

fix(scrapers): a single-colon ysm, bbs or yse PI key joins to nothing #2809

Description

@quntao-z

Follows #2799, which taught the materializer to resolve a roster email alias to a real netid. A second shape of inferredPiUserKey still cannot join.

The gap

inferredPiUserKeyIdentity reads a person name out of dept:<unit>:<name> only. A single-colon namespace key, ysm:<name> or bbs:<name> or yse:<name>, falls through to the netid branch, where the payload is a name rather than a netid and is not an email alias either, so #2799's directory map does not reach it. The key joins to nothing and the entity stays lead-blocked.

Scale on Development

621 keys in those three namespaces, every one joinable to a user observation. On a 200-key sample the name resolver answers matched 161, ambiguous 22, absent 17.

missing_lead stands at 519 entities after #2799's data operation ran.

Excluded

nih-pi: keys are left unparsed on purpose. They name grant PIs who may hold no Yale appointment, and rows carrying them also raise grant_only_no_current_yale_source.

Pending application

This is a stored-data change, so merging the code moves nothing. It needs observations:materialize-pi-attributed-users --apply for the absent cases and then a re-materialization of the affected entities, because materializeCanonicalPiMemberships runs on the researchEntity path rather than the user path. This issue stays open until both passes have run on Development and missing_lead has been re-measured from the scoreboard.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions