Skip to content

plotted points are not matching what is known from DLC analyze_videos #7

Description

@MMathisLab

plotted points are not matching what is known from DLC analyze_videos: @AlexEMG this is the newly exported model, fyi.

Screen Shot 2020-07-09 at 7 26 51 PM

same video:
Screen Shot 2020-07-09 at 7 28 23 PM

Originally posted by @MMathisLab in #1 (comment)

Moreover, this is true for all model_zoo models.

This is using the default model_export function, so this is crucial that it must work.

Activity

  1. MMathisLab commented on Jul 10, 2020

    @MMathisLab
    MemberAuthor

    you can test this with any model zoo, simple download by:

    import deeplabcut
    import urllib.request
    import tarfile
    from tqdm import tqdm
    from deeplabcut.utils import auxiliaryfunctions
    modelname = 'full_cat'
    deeplabcut.utils.auxfun_models.DownloadModel(modelname, '/content/')
  2. MMathisLab commented on Jul 10, 2020

    @MMathisLab
    MemberAuthor

    @gkane26 can you elaborate how you've tried to fix this? WE said try the non-pb files, right, but how do I point to only those, as in dlclive.anv you point to a folder

  3. gkane26 commented on Jul 10, 2020

    @gkane26
    Collaborator

    I haven't yet tried loading the snapshot file -- can't do that in DLC-live because you need a lot of DLC functions to recreate the network, then load the weights. I can try doing so this afternoon, but what that amounts to is essentially just running DLC's analyze_videos. I think the issue has to be that we're either choosing the wrong input/output nodes in DLC export.py or in dlclive.graph.py. I've tried some different combinations of but I'm pretty sure it's using the correct ones now

  4. MMathisLab commented on Jul 10, 2020

    @MMathisLab
    MemberAuthor

    I think @AlexEMG is looking into the TF graph business now

  5. sneakers-the-rat commented on Jul 14, 2020

    @sneakers-the-rat
    Collaborator

    I think this needs a fix! I was experiencing this all day today and had resigned myself to thinking I was doing something wrong -- the numbers from dlc proper (specifically those in the plot.png generated from plot trajectories) were pretty consistently wrong from the numbers dlclive was giving across multiple models and retraining even when my camera and imaging plane were firmly clamped in place and unchanging. I think it might be an indexing error

  6. MMathisLab commented on Jul 14, 2020

    @MMathisLab
    MemberAuthor

    It was fixed in the PR #1 from GK, see discussion

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions