abstract dataclass inheritance gives Only concrete class can be given where "Type[Abstract]" is expected
#5374
Comments
|
What if you remove the meta class?
On Wed, Jul 18, 2018 at 9:01 PM Jonas Obrist ***@***.***> wrote:
mypy 0.620, --strict.
Sample code:
import abcfrom dataclasses import dataclass
@DataClass # error: Only concrete class can be given where "Type[Abstract]" is expectedclass Abstract(metaclass=abc.ABCMeta):
a: str
@abc.abstractmethod
def c(self) -> None:
pass
@dataclassclass Concrete(Abstract):
b: str
def c(self) -> None:
pass
instance = Concrete(a='hello', b='world')
Note that this error *only* occurs if at least one abstract method is
defined on the abstract class. Removing the abstract method c (or making
it non-abstract) makes the error go away.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
<#5374>, or mute the thread
<https://github.com/notifications/unsubscribe-auth/ACwrMmnqdQS-PT-Ppma35aXOsPpD6X7vks5uIASAgaJpZM4VVt0v>
.
--
--Guido (mobile)
|
|
Removing the metaclass still triggers it. Minimal code to get that error: import abc
from dataclasses import dataclass
@dataclass
class Abstract:
@abc.abstractmethod
def c(self) -> None:
pass |
|
The underlying cause is this: from typing import Type, TypeVar
from abc import abstractmethod
T = TypeVar('T')
class C:
@abstractmethod
def f(self) -> None: ...
def fun(x: Type[T]) -> Type[T]: ...
fun(C)A possible simple solution is to type |
|
Lifting this constraint would be great for fetching implementations to interfaces (abstracts/protocols). T_co = TypeVar('T_co', covariant=True)
def register(interface: Type[T_co], implementation: Type[T_co]) -> Type[T_co]: ...
def inject(interface: Type[T_co]) -> T_co: ... |
|
Just a bit of context why this is prohibited: mypy always allows instantiation of something typed as from typing import Type, TypeVar
from abc import abstractmethod
T = TypeVar('T')
class C:
@abstractmethod
def f(self) -> None: ...
def fun(x: Type[T]) -> T: ...
return x() # mypy allows this, since it is a very common pattern
fun(C) # this fails at runtime, and it would be good to catch it statically,
# what we do currentlyI am still not sure what is the best way to proceed here. Potentially, we can only prohibit this if original function argument (or its upper bound) is abstract (so function actually expects implementations to be passed). This will be a bit unsafe, but more practical, as all examples provided so far would pass. |
I'm leaning towards allowing abstract classes to be used without restriction. |
This will be false negative, so probably OK. |
|
Sorry to bother, but is there some ETA on this issue? |
|
There is no concrete work planned for this issue yet, we are focusing on high-priority issues. |
|
I'm having a similar error and I don't know if it's the same problem or a different, related problem (or perhaps I'm doing something wrong), related to abstract classes and Attrs. I have this abstract class: https://github.com/eventbrite/pymetrics/blob/ab608978/pymetrics/recorders/base.py#L38-L39 Then I have this constant: _DEFAULT_METRICS_RECORDER = NoOpMetricsRecorder() # type: MetricsRecorderAnd this Attrs class: @attr.s
@six.add_metaclass(abc.ABCMeta)
class RedisTransportCore(object):
...
metrics = attr.ib(
default=_DEFAULT_METRICS_RECORDER,
validator=attr.validators.instance_of(MetricsRecorder),
) # type: MetricsRecorderOn the line with
What's interesting is that this only happens with today's released Attrs 19.2.0 and last week's released MyPy 0.730. If I downgrade to Attrs 19.1.0 and keep the latest MyPy, the error goes away. If I downgrade to MyPy 0.720 and keep the latest Attrs, the error goes away. I'm able to get around the problem by adding |
|
This is really sad, given that dataclasses are being pushed as a go-to class container in 3.7+, having abstract dataclasses is not such a rare occasion. But mypy in the current state basically prohibits using it. Given that this issue is 1.5 years old, wonder if there's any known workarounds? |
|
Marking as high priority, since there seems to be quite a lot of interest in getting this fixed. |
|
Depending on your needs, for a temporary workaround, you can do the following, which type checks with import abc
import dataclasses
class AbstractClass(abc.ABC):
"""An abstract class."""
@abc.abstractmethod
def method(self) -> str:
"""Do something."""
@dataclasses.dataclass
class DataClassMixin:
"""A dataclass mixin."""
spam: str
class AbstractDataClass(DataClassMixin, AbstractClass):
"""An abstract data class."""
@dataclasses.dataclass
class ConcreteDataClass(AbstractDataClass):
"""A concrete data class."""
eggs: str
def method(self) -> str:
"""Do something."""
return "{} tastes worse than {}".format(self.spam, self.eggs)
print(ConcreteDataClass("spam", "eggs").method())
# -> "spam tastes worse than eggs" |
|
Similar to @cybojenix, we would be very happy if from typing import Any, Dict, TypeVar, Type
from typing_extensions import Protocol
ServiceType = TypeVar("ServiceType")
registrations: Dict[Any, Any] = {}
def register(t: Type[ServiceType], impl: ServiceType) -> None:
registrations[t] = impl
def locate(t: Type[ServiceType]) -> ServiceType:
return registrations[t]
class ThingService(Protocol):
def serve(str) -> str:
pass
class ThingImpl(ThingService):
def serve(str) -> str:
return "fish"
register(ThingService, ThingImpl())
thing: ThingService = locate(ThingService)
print(thing.serve()) |
|
Interestingly, the given rationale of not allowing abstract classes ("mypy always allows instantiation of something typed as Type[...], in particular of function arguments"), does not seem to match its implementation, as classes based on To elaborate (and give another example to possibly test a fix against later), the following code uses only from abc import ABC, abstractmethod
from typing import List, Type, TypeVar
AB = TypeVar("AB", "A", "B") # Could be A or B (Union)
class A:
@abstractmethod
def snork(self):
pass
class B:
@abstractmethod
def snork(self):
pass
class oneA(A):
pass
class anotherA(A):
pass
class someB(B):
pass
def make_objects(of_type: Type[AB]) -> List[AB]:
return [cls() for cls in of_type.__subclasses__()]
if __name__ == "__main__":
print(make_objects(A))
print(make_objects(B))Removing the two |
|
Running into the same issue. |
|
Similar to @ToBeReplaced, workaround I've been using: @dataclass
class _AbstractDataclass:
id: int
class AbstractDataclass(_AbstractDataclass, abc.ABC):
@abc.abstractmethod
def c(self) -> None:
pass |
Mypy doesn't handle abstract dataclasses well. See python/mypy#5374 (comment)
|
Another use-case which also doesn't work due to this limitation is the adapter pattern using typing Protocols. i.e.:
|
Mypy complains about abstract dataclassses. See python/mypy#5374.
Found the following issue that needs me to change some implementation logic
in Hikari to make this work properly.
```
self._context.bot.unsubscribe(hikari.ReactionAddEvent, self._p...
^
lightbulb/utils/nav.py:136:39: error: Only concrete class can be given where
"Type[ReactionAddEvent]" is expected [misc]
```
Seems to be linked to python/mypy#5374
|
This is over 2 years old, and 0.800 just started doing a better job at finding these cases which resulted with a wall of errors in my project. Thanks, mypy. :( |
|
@mkielar could you give concrete examples of code that started erroring? Perhaps we can easily fix the regression. |
|
My production code cut to be smaller: import dataclasses as dc
from abc import ABCMeta, abstractmethod
@dc.dataclass(frozen=True)
class CanaryConfiguration(metaclass=ABCMeta):
@abstractmethod
def is_fast_track(self) -> bool:
"""
"""
@dc.dataclass(frozen=True)
class CanaryConfigurationEcs(CanaryConfiguration):
def is_fast_track(self) -> bool:
return True
@dc.dataclass(frozen=True)
class Canary:
configuration: CanaryConfiguration
def test_me() -> bool:
c: Canary = Canary(CanaryConfigurationEcs())
return c.configuration.is_fast_track()Console output: → mypy --version
mypy 0.800
→ mypy test.py
test.py:5: error: Only concrete class can be given where "Type[CanaryConfiguration]" is expected
Found 1 error in 1 file (checked 1 source file)In actual code it additionally complains that the |
The error about "Only concrete class can be given where "Type[View]" is expected" is a false positive in Mypy. They should fix it on their side. See also python/mypy#5374
|
Adding one more (hopefully) valid use case from dataclasses import dataclass, fields, is_dataclass
from typing import Protocol, Optional, cast
@dataclass
class MyConfig:
v1: str
v2: 'Optional[str]' = None
@dataclass
class GlobalConfig:
MyConfig: MyConfig
class SourceList(Protocol):
def get(self, key: str) -> str:
pass
class ConfigProtocol(Protocol): # this is one option, but just being able to type check dataclass would be fine
__dataclass_fields__: dict
class Configuration:
def __init__(
self,
source_list: SourceList,
config_class: ConfigProtocol = GlobalConfig
):
self._config_sources = source_list
for f in fields(self._config_class):
if is_dataclass(f.type):
setattr(
self,
f.name,
Configuration(
source_list=source_list,
config_class=cast(ConfigProtocol, f.type)
)
)
def __getattr__(self, name):
if value := self._config_sources.get(name):
return value
raise AttributeError()mypy output:
Define dataclasses for config objects in modules and sub-modules, which can be instantiated and used directly, or as shown here, used as templates to build a more complex config class. |
Also fixes a problem in AssertImplements due to python/mypy#5374.
Also fixes a problem in AssertImplements due to python/mypy#5374.
Also fixes a problem in AssertImplements due to python/mypy#5374.
Also fixes a problem in AssertImplements due to python/mypy#5374.
mypy 0.620,
--strict.Sample code:
Note that this error only occurs if at least one abstract method is defined on the abstract class. Removing the abstract method
c(or making it non-abstract) makes the error go away.The text was updated successfully, but these errors were encountered: