Sort bins from pandas cut
There is main problem losing ordered
CategoricalIndex
.
np.random.seed(12456)
y = pd.Series(np.random.randn(100))
x1 = pd.Series(np.sign(np.random.randn(100)))
x2 = pd.cut(pd.Series(np.random.randn(100)), bins = [-3, -0.5, 0, 0.5, 3])
model = pd.concat([y, x1, x2], axis = 1, keys = ['Y', 'X1', 'X2'])
int_output = model.groupby(['X1', 'X2']).mean().unstack()
int_output.columns = int_output.columns.get_level_values(1)
print (int_output)
X2 (-3, -0.5] (-0.5, 0] (0, 0.5] (0.5, 3]
X1
-1.0 0.230060 -0.079266 -0.079834 -0.064455
1.0 -0.451351 0.268688 0.020091 -0.280218
print (int_output.columns)
CategoricalIndex(['(-3, -0.5]', '(-0.5, 0]', '(0, 0.5]', '(0.5, 3]'],
categories=['(-3, -0.5]', '(-0.5, 0]', '(0, 0.5]', '(0.5, 3]'],
ordered=True, name='X2', dtype='category')
output = pd.concat(int_output.to_dict('series'), axis = 1)
print (output)
(-0.5, 0] (-3, -0.5] (0, 0.5] (0.5, 3]
X1
-1.0 -0.079266 0.230060 -0.079834 -0.064455
1.0 0.268688 -0.451351 0.020091 -0.280218
print (output.columns)
Index(['(-0.5, 0]', '(-3, -0.5]', '(0, 0.5]', '(0.5, 3]'], dtype='object')
One possible solution is extract
first number from output.columns
, create helper Series and sort it. Last reindex
original columns:
cat = output.columns.str.extract('\((.*),', expand=False).astype(float)
a = pd.Series(cat, index=output.columns).sort_values()
print (a)
(-3, -0.5] -3.0
(-0.5, 0] -0.5
(0, 0.5] 0.0
(0.5, 3] 0.5
dtype: float64
output = output.reindex(columns=a.index)
print (output)
(-3, -0.5] (-0.5, 0] (0, 0.5] (0.5, 3]
X1
-1.0 0.230060 -0.079266 -0.079834 -0.064455
1.0 -0.451351 0.268688 0.020091 -0.280218