Fetch messages since a specific time?
Hello, Is it possible to fetch messages from the Kafka message queue since a specific time? For example, a user may subscribe to a topic and the producer will continuously publish messages related to...
View ArticleFetch messages since a specific time?
The SimpleConsumer API [1] has a method called getOffsetsBefore which takes a topic, partition, timestamp (UNIX I assume since it's a long) and integer limit on how many offsets to get. Might not solve...
View ArticleFetch messages since a specific time?
Mathias, Thanks for response. I am not sure if this timestamp is the Unix time or not. I've tried the following: Create 3 messages of the same topic, at the same partition like this: 1355769714152:...
View ArticleFetch messages since a specific time?
Hm, alright. Haven't really used the method to anything besides getting first and last offset (using -1 and -2 as timestamps IIRC) of a topic+partition combination. Maybe someone else can shed some...
View ArticleFetch messages since a specific time?
Each message does not have a time stamp. Groups of messages (I think the default is around 500mb) are stored in individual files, and the time stamp parameter will find the offset at the beginning of...
View ArticleFetch messages since a specific time?
I see. Thanks for your response, Tom. Jason -- Jason Huang
View Article