video stream format was changed at scrcpy 2.x .

[tokoroten]

video stream format was changed at scrcpy 2.x .

https://github.com/Genymobile/scrcpy/blob/master/doc/develop.md#video-and-audio

• at first, 12 byte frame-header is coming
• and next, frame data.

current implementation is not use this 12 byte header.
and PyAV codec will be ignore this header.

https://github.com/leng-yue/py-scrcpy-client/blob/main/scrcpy/core.py#L236-L248

I think, #75 is would occurred by this.

This is my forked code.
Bat too many changes to merge, so this is for reference.

        SC_PACKET_FLAG_CONFIG = 1 << 63
        SC_PACKET_FLAG_KEY_FRAME = 1 << 62
        SC_PACKET_PTS_MASK = (1 << 62) - 1

        self.__video_socket.setblocking(True)

        while self.alive:
            try:
                video_header = self.__video_socket.recv(12)
                if len(video_header) == 0:
                    raise ConnectionError("Video stream is disconnected")
                if len(video_header) != 12:
                    raise ConnectionError("Video header is less than 12 bytes")

                (pts, data_packet_length) = struct.unpack(">QL", video_header)
                config_flag = pts & SC_PACKET_FLAG_CONFIG
                keyframe_flag = pts & SC_PACKET_FLAG_KEY_FRAME
                pts = pts & SC_PACKET_PTS_MASK 

                if config_flag:
                    # todo: manage config flag
                    print("video config flag comming!")
                    self.__send_to_listeners(EVENT_FRAME_CONFIG_CHANGE) 
                    
                video_data = b""
                while True:
                    revived_data = self.__video_socket.recv(data_packet_length - len(video_data))
                    if len(revived_data) == 0:
                        raise ConnectionError("Video stream is disconnected")
                    
                    if len(video_data) == 0:
                        video_data = revived_data
                    else:
                        video_data += revived_data

                    if len(video_data) == data_packet_length:
                        break

                packets = codec.parse(video_data)
                for packet in packets:
                    frames = codec.decode(packet)
                    for frame in frames:
                        if pts == 0:
                            continue

                        frame = frame.to_ndarray(format="bgr24")
                        if self.flip:
                            frame = frame[:, ::-1, :]
                        self.last_frame = frame
                        self.resolution = (frame.shape[1], frame.shape[0])
                        self.__send_to_listeners(EVENT_FRAME, frame, pts)