At work, I've been using the kafka-python library, as that's what my team has been using. Yesterday afternoon, the senior developer on the team determined that no, it wasn't a network issue holding me up (as they were working for 3 days on the Kafka nodes and my stack trace was pointing to API code that indicated I couldn't connect to the server). The problem was that the Click API encoded the topic_name using unicode in a way that Kafka couldn't process.
Today, I have been working to have my Python script checkpoint in the log; so if it is unexpectedly terminated, it can recover from close to where it stopped. It turns out that the kafka-python API only supports checkpointing during an application run instance, meaning checkpoints aren't saved if the application is terminated. I filed a bug report on Github and got this response from one of the collaborators:
"Thanks for filing! I actually have never looked at OffsetCommitContext ... not sure if that works as advertised and pretty sure we have no tests for it. needs investigation."
2383 Replies - 83797 Views - Last Post: 22 July 2015 - 02:34 PM
#2042
Re: What are you working on today?
Posted 19 June 2015 - 02:28 PM
Got the backbone of my ultra-light php framework done today. Still need to implement the templating system and add in some security features.
#2043
Re: What are you working on today?
Posted 22 June 2015 - 05:22 AM
For the past couple nights there have been storms here in Indiana. My willow tree got destroyed, my garage light was ripped off, and y patio chairs were up against my window. The weird part is I didn't even get a weather advisory on my phone, nor did Chelsea.
#2044
Re: What are you working on today?
Posted 22 June 2015 - 05:48 AM
Today: Meetings, Derpicorn, and service desk tickets.
Tomorrow: Bailing out of work early and trekking to Pittsburgh for a Barenaked Ladies/Violent Femmes concert (Hipster won tickets in a Facebook contest).
Wednesday: Taking the day off to recover from the Barenaked Ladies/Violent Femmes concert.
Tomorrow: Bailing out of work early and trekking to Pittsburgh for a Barenaked Ladies/Violent Femmes concert (Hipster won tickets in a Facebook contest).
Wednesday: Taking the day off to recover from the Barenaked Ladies/Violent Femmes concert.
#2045
Re: What are you working on today?
Posted 22 June 2015 - 06:04 AM
Menu Today:
Dev Day
Dev Day
#2046
Re: What are you working on today?
Posted 22 June 2015 - 06:30 AM
I'm so confused by this woman I've been talking to. Hot and cold...but I think I just lined up another date. So we'll see how that goes.
#2047
Re: What are you working on today?
Posted 22 June 2015 - 07:25 AM
Working on a feature until 4AM, overslept, working from home today, trying to get that deployed before noon and then kill a bunch of issues.
Going to be making heavy use of the Aeropress today.
Going to be making heavy use of the Aeropress today.
#2048
Re: What are you working on today?
Posted 22 June 2015 - 09:06 AM
We moved downstairs. I got screwed major time. They moved me to a pod position that didn't have an end (cork/white board, the worst chair in the building, monitors in full view of snitchbitch, and MY SUPER AWESOME SPECIAL MONITORS DIDN'T COME WITH!!!! I was on the verge of tears I was so angry. I moved pod spots, so now I got the end piece, and I stole a better chair, and my monitors aren't in her view, but I still don't have my monitors. Also the monitor arms will not move and they're all wonky. Needless to say, I'm having a spoiled, 5-year-old-style hissy fit today.
#2050
Re: What are you working on today?
Posted 22 June 2015 - 09:21 AM
Could be worse. We're on an "open plan" office - nobody has a desk, so every morning I have to find an available desk with a monitor, get my keyboard and so forth from my locker, and rebuild my workstation, and then tear it down again at the end of the day.
It looks like this nonsense is going to end soon, at least for some of us, but man it's been annoying.
It looks like this nonsense is going to end soon, at least for some of us, but man it's been annoying.
#2051
Re: What are you working on today?
Posted 22 June 2015 - 09:23 AM
At that point, it's easier to use a laptop and just connect to whatever monitors are available.
#2052
Re: What are you working on today?
Posted 22 June 2015 - 09:30 AM
Just wanting to sit here and cry.
Apparently over the weekend/ last week at some point there was a significant data breach at where I work. Significant enough that corporate decided to totally separate the engineering and corporate networks, and to do it all over the weekend so we would come in today and carry on with life. Too bad for them they did it so half-assed that they ran out of "virtual" desktops to connect to, leaving me and a number of others without any way to do ANYTHING (I can't look at defects, modify source code, connect to my arrays, or anything without going through the new virtual desktops.
They also were so paranoid that I can't connect to any servers except for Wichita's, so I can't even attempt to use a different site's virtual desktops to get any work done.
I am literally sitting here hoping that I can eventually get connected to a virtual desktop... at some point...
Apparently over the weekend/ last week at some point there was a significant data breach at where I work. Significant enough that corporate decided to totally separate the engineering and corporate networks, and to do it all over the weekend so we would come in today and carry on with life. Too bad for them they did it so half-assed that they ran out of "virtual" desktops to connect to, leaving me and a number of others without any way to do ANYTHING (I can't look at defects, modify source code, connect to my arrays, or anything without going through the new virtual desktops.
They also were so paranoid that I can't connect to any servers except for Wichita's, so I can't even attempt to use a different site's virtual desktops to get any work done.
I am literally sitting here hoping that I can eventually get connected to a virtual desktop... at some point...
#2053
Re: What are you working on today?
Posted 22 June 2015 - 09:33 AM
Quote
nobody has a desk, so every morning I have to find an available desk with a monitor, get my keyboard and so forth from my locker, and rebuild my workstation, and then tear it down again at the end of the day.
That's one of the most ridiculous office "solutions" I've heard of. Someone should point out that they can save time and make things more efficient by leaving your workstation set up at the end of the night, so you can come in and start working immediately. What exactly is that plan trying to accomplish, what problem is it solving by making you build and tear down your space every day? Was there a problem that people were being too efficient, and this is the solution?
This is a wild guess, but was this policy implemented by someone in the company who actually does have a permanent desk and setup? It would be pretty great if the executives had to find an open office at the beginning of every day and move their filing cabinets and everything into it from their personal storage locker.
#2054
Re: What are you working on today?
Posted 22 June 2015 - 09:38 AM
At a guess, they wanted to "not be corporate, man." That's what that sounds like to me. "Nah dude, we're not a cubicle farm, we don't even have assigned desks. Just grab a computer and go, man."
And now jon works for Jeff Bridges in my mind.
And now jon works for Jeff Bridges in my mind.
#2055
Re: What are you working on today?
Posted 22 June 2015 - 09:59 AM
We have "open floorplans", but with assigned seating. Anybody can plug their laptops into an empty space with monitors, but we have our phone, docking stations, etc. at our pod.

New Topic/Question
This topic is locked






MultiQuote







|