when input is zero, your transistor is off. there will be no current flow between collector and emitter. so CE junction acts as open, so full voltage appears across CE junction and you get output as high!
when input is high, the CE junction acts as short, so it appears as output is connected to ground. so output voltage will be 0.
I am assuming you want to use an input voltage between 0V and 5V? If so, you will never turn on the PNP the way you have drawn it. The base of a PNP needs to be more negative than the emitter to turn it on. You could use a PNP with the emitter to +5V and the resistor load to 0V.