Extracting learnt embeddings for analysis #182
Description
Hi @lucidrains,
Amazing work on this package, it is really helpful!
I am using my the QINCo (ResVQ + implicit_neural_codebook = True) for my work. I have trained my model on the data with 8 quantizers. I would now like to assess the quality of my embeddings by linear probing. I am a little confused with what to use as my embeddings for the same. I could either use raw_embeddings=res_vq_layer.codebook or embeddings=residual_vq_layer.get_codes_from_indices(indices) (as per issue #44). Could you guide me with the same?